2024-09-19T08:43:01.926 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:43:01.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:43:02.065 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911879' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjfZuPKWzBHXSn/JyL57i+rh8axszO05rSMXJzXeB8BAAg9EeFXu3Nfx8KBjCsMOQT4IdDN8AHzBaumH6yXtZY= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLaffc0GK3vDru7i5Aqs9tEUQa6tavqC1a1tAFOoy85hAhixUf72Anm3Z5bl1h+heklDY3dPno1Ja6xFNPWcpLM= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOy3RG+rW6hbq1/p7c4zkBelv59aBduukzZC3G0tGBFj8ZeMf6ZLqolHKuX9HWzuW6qqEITqfOLdLODqFMLZPpc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:43:02.065 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:43:02.066 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:43:02.066 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:43:02.068 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:43:02.091 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:43:02.091 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:43:02.091 INFO:teuthology.packaging:ref: None 2024-09-19T08:43:02.091 INFO:teuthology.packaging:tag: None 2024-09-19T08:43:02.091 INFO:teuthology.packaging:branch: squid 2024-09-19T08:43:02.091 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:43:02.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:43:02.298 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:43:02.300 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:43:02.305 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:43:02.305 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:43:02.345 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:43:02.373 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:43:02.379 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:43:02.405 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:37:56.753703', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjfZuPKWzBHXSn/JyL57i+rh8axszO05rSMXJzXeB8BAAg9EeFXu3Nfx8KBjCsMOQT4IdDN8AHzBaumH6yXtZY='} 2024-09-19T08:43:02.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:37:56.752034', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLaffc0GK3vDru7i5Aqs9tEUQa6tavqC1a1tAFOoy85hAhixUf72Anm3Z5bl1h+heklDY3dPno1Ja6xFNPWcpLM='} 2024-09-19T08:43:02.453 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:37:56.754951', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOy3RG+rW6hbq1/p7c4zkBelv59aBduukzZC3G0tGBFj8ZeMf6ZLqolHKuX9HWzuW6qqEITqfOLdLODqFMLZPpc='} 2024-09-19T08:43:02.454 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:43:02.459 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:43:02.459 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:43:02.459 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:43:02.459 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:43:02.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f222e943520>, signals=[15]) 2024-09-19T08:43:02.564 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:43:02.569 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:43:02.569 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T08:43:02.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:02.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-19T08:43:02.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:02.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-09-19T08:43:02.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:02.808 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:43:02.815 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-09-19T08:43:02.833 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-09-19T08:43:02.834 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:43:02.892 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-09-19T08:43:02.893 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:43:02.893 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:43:02.893 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:43:02.893 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:43:02.893 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:43:02.893 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:43:02.894 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-09-19T08:43:02.932 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-19T08:43:02.950 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-19T08:43:02.951 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:43:03.009 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:43:03.010 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:43:03.010 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-19T08:43:03.037 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-09-19T08:43:03.056 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-09-19T08:43:03.056 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-09-19T08:43:03.114 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-09-19T08:43:03.114 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-09-19T08:43:03.114 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-09-19T08:43:03.114 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:43:03.114 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:43:03.115 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:43:03.115 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-09-19T08:43:03.137 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:43:03.147 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:43:03.170 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:43:03.170 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:43:03.173 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:43:03.175 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:43:03.192 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:43:03.197 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:43:03.198 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:43:03.230 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:43:03.232 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:43:03.257 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:43:03.325 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:43:03.339 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:43:03.340 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T08:43:03.340 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:43:03.341 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:43:03.341 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:43:03.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:43:03.358 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-09-19T08:43:03.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:43:03.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:43:03.360 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-19T08:43:03.360 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-19T08:43:03.415 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:43:03.415 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.14.0-503.el9.x86_64 2024-09-19T08:43:03.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2024-09-19T08:43:03.417 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:43:03.418 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.14.0-503.el9.x86_64 2024-09-19T08:43:03.418 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2024-09-19T08:43:03.419 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:43:03.419 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-503.el9.x86_64 2024-09-19T08:43:03.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-09-19T08:43:07.205 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.3 MB 00:02 2024-09-19T08:43:07.275 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.3 MB 00:02 2024-09-19T08:43:07.388 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.3 MB 00:02 2024-09-19T08:43:09.123 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-19T08:43:09.625 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-19T08:43:14.349 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-19T08:43:15.193 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-19T08:43:15.799 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-19T08:43:16.389 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-19T08:43:16.760 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-19T08:43:16.837 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T08:43:17.764 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T08:43:22.234 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T08:43:22.731 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-19T08:43:23.162 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-19T08:43:24.141 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:43:24.141 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:43:24.236 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout: Package Architecture Version Repository Size 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:43:24.244 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout:Install 4 Packages 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 79 M 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout:Installed size: 126 M 2024-09-19T08:43:24.245 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-19T08:43:24.407 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-19T08:43:24.627 INFO:teuthology.orchestra.run.smithi083.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 349 kB/s | 36 kB 00:00 2024-09-19T08:43:25.028 INFO:teuthology.orchestra.run.smithi083.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T08:43:25.035 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:43:25.035 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:43:25.141 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-19T08:43:25.156 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-19T08:43:25.156 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:Install 4 Packages 2024-09-19T08:43:25.157 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:43:25.158 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 79 M 2024-09-19T08:43:25.158 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 126 M 2024-09-19T08:43:25.158 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-19T08:43:25.261 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T08:43:25.470 INFO:teuthology.orchestra.run.smithi083.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-19T08:43:25.505 INFO:teuthology.orchestra.run.smithi184.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 384 kB/s | 36 kB 00:00 2024-09-19T08:43:25.728 INFO:teuthology.orchestra.run.smithi083.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-19T08:43:25.728 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:43:25.729 INFO:teuthology.orchestra.run.smithi083.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-19T08:43:25.897 INFO:teuthology.orchestra.run.smithi184.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T08:43:26.382 INFO:teuthology.orchestra.run.smithi184.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-19T08:43:26.412 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-19T08:43:26.639 INFO:teuthology.orchestra.run.smithi184.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-19T08:43:26.639 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:43:26.639 INFO:teuthology.orchestra.run.smithi184.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-19T08:43:26.749 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-19T08:43:26.749 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-19T08:43:27.329 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-19T08:43:27.677 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-19T08:43:27.677 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-19T08:43:27.695 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-19T08:43:27.696 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-19T08:43:28.663 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-19T08:43:28.663 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-19T08:43:30.132 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-19T08:43:30.634 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:43:30.773 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:43:30.857 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:43:31.096 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-19T08:43:31.778 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:43:31.900 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:43:32.541 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:43:32.541 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:43:32.631 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-19T08:43:32.642 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-19T08:43:32.642 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-09-19T08:43:32.643 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:43:32.644 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 79 M 2024-09-19T08:43:32.644 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 126 M 2024-09-19T08:43:32.644 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-19T08:43:32.894 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 304 kB/s | 36 kB 00:00 2024-09-19T08:43:33.194 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-19T08:43:33.602 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:43:33.603 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 42 MB/s | 35 MB 00:00 2024-09-19T08:43:33.734 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:43:33.912 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 28 MB/s | 29 MB 00:01 2024-09-19T08:43:33.912 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:43:33.912 INFO:teuthology.orchestra.run.smithi122.stdout:Total 62 MB/s | 79 MB 00:01 2024-09-19T08:43:34.593 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-19T08:43:34.661 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:43:34.786 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:43:34.926 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-19T08:43:34.926 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-19T08:43:35.897 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-19T08:43:35.897 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-19T08:43:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-19T08:43:38.541 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:43:38.651 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:43:38.994 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:43:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:43:39.646 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:43:39.695 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:43:41.876 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:43:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:43:43.533 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:43:44.565 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:43:46.823 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:43:46.867 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:43:51.712 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:21.927 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:21.966 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:22.320 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:22.320 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:44:22.320 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:44:22.320 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:44:22.856 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:22.896 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:23.156 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:23.156 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:44:23.156 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-19T08:44:23.156 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:23.156 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:44:23.156 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:44:23.157 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:44:23.157 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:44:23.157 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-19T08:44:23.179 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:23.179 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:44:23.179 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:44:23.179 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:44:23.494 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:44:23.586 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:23.586 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:44:23.586 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:44:23.586 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:44:23.586 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:44:23.587 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T08:44:23.587 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:44:23.587 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:44:23.645 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:23.645 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:44:23.645 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.06 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 82.el9 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Group : Unspecified 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 8274670 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:44:23.684 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : builder@centos.org 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : CentOS 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:44:23.685 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:44:23.686 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:44:23.686 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:44:23.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:44:24.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:24.027 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:44:24.027 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-19T08:44:24.027 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:24.027 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:44:24.028 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:44:24.028 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:44:24.028 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:44:24.028 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-19T08:44:24.374 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-09-19T08:44:24.407 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:24.490 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:44:24.490 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:44:24.491 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:44:24.491 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:44:24.491 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T08:44:24.491 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:44:24.491 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:44:24.550 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:24.550 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:44:24.550 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.06 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 82.el9 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Group : Unspecified 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 8274670 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:44:24.583 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : builder@centos.org 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:44:24.584 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:44:24.585 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:44:24.585 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:44:24.586 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:44:25.185 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-09-19T08:44:25.782 INFO:teuthology.orchestra.run.smithi083.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:44:25.817 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-09-19T08:44:25.820 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-19T08:44:25.838 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.7gRhzaZroo 2024-09-19T08:44:25.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7gRhzaZroo 2024-09-19T08:44:25.905 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.7gRhzaZroo 2024-09-19T08:44:26.045 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.7gRhzaZroo is 6KB 2024-09-19T08:44:26.098 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.7gRhzaZroo 2024-09-19T08:44:26.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:44:26.175 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:44:26.175 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:44:26.175 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:44:26.175 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:44:26.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:44:26.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-09-19T08:44:26.471 INFO:teuthology.orchestra.run.smithi184.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:44:26.510 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-09-19T08:44:26.512 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-09-19T08:44:26.527 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.OJOQbGcrfL 2024-09-19T08:44:26.528 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OJOQbGcrfL 2024-09-19T08:44:26.601 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.OJOQbGcrfL 2024-09-19T08:44:26.762 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.OJOQbGcrfL is 6KB 2024-09-19T08:44:26.812 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.OJOQbGcrfL 2024-09-19T08:44:26.828 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:44:26.892 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:44:26.893 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:44:26.893 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:44:26.893 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:44:26.894 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:44:27.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-09-19T08:44:30.408 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:30.758 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:30.758 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:44:30.758 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:44:30.758 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:44:31.606 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:31.606 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:44:31.606 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-19T08:44:31.606 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:44:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:44:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:44:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:44:31.607 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-19T08:44:31.944 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:44:32.020 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:32.020 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:44:32.021 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:44:32.021 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:44:32.021 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:44:32.021 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T08:44:32.021 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:44:32.021 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:44:32.080 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:44:32.080 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:44:32.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-09-19T08:44:32.111 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 82.el9 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8274670 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:44:32.112 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:44:32.113 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:44:32.114 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:44:32.114 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:44:32.114 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:44:32.785 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-09-19T08:44:34.082 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:44:34.112 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-09-19T08:44:34.118 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-19T08:44:34.134 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.1nWoHQjeiK 2024-09-19T08:44:34.134 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1nWoHQjeiK 2024-09-19T08:44:34.201 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.1nWoHQjeiK 2024-09-19T08:44:34.347 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.1nWoHQjeiK is 6KB 2024-09-19T08:44:34.367 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.1nWoHQjeiK 2024-09-19T08:44:34.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:44:34.445 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:44:34.445 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:44:34.445 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:44:34.446 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:44:34.447 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:44:34.593 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-09-19T08:44:56.349 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T08:44:56.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:44:56.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:44:57.065 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T08:44:57.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-19T08:44:57.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:04.603 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T08:45:04.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:45:04.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:14.689 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-19T08:45:15.457 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-09-19T08:45:23.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-19T08:45:23.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:45:23.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:24.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-19T08:45:24.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:26.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-19T08:45:27.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-09-19T08:45:32.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:45:32.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:35.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-19T08:45:38.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:45:38.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:39.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-19T08:45:39.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:47.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:45:47.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:57.185 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-19T08:46:05.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-19T08:46:11.351 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-19T08:46:12.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-19T08:46:12.078 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:46:12.079 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-09-19T08:46:12.093 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:46:12.093 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:46:12.093 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:46:12.093 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:46:12.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:46:12.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:46:12.534 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-19T08:46:12.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:46:12.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:46:12.954 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-19T08:46:12.969 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:46:12.969 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:46:12.969 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:46:12.969 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:46:13.094 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T08:46:13.095 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:46:13.153 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-09-19T08:46:13.174 DEBUG:teuthology.parallel:result is None 2024-09-19T08:46:13.970 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T08:46:13.970 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:46:14.056 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2024-09-19T08:46:14.083 DEBUG:teuthology.parallel:result is None 2024-09-19T08:46:20.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:46:20.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:46:20.957 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-19T08:46:21.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:46:21.351 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:46:21.351 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-19T08:46:21.365 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:46:21.366 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:46:21.366 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:46:21.366 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:46:22.367 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T08:46:22.368 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:46:22.459 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-09-19T08:46:22.488 DEBUG:teuthology.parallel:result is None 2024-09-19T08:46:22.488 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:46:22.496 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:46:22.496 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:46:22.499 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:46:22.505 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:46:22.531 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:46:22.537 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:46:22.569 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:46:22.569 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:46:22.572 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:46:22.575 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:46:22.639 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:46:22.645 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:46:22.645 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:46:22.648 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:46:22.650 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:46:22.676 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:46:22.682 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:46:22.687 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:46:22.693 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:46:22.735 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:46:22.755 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:46:22.757 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:46:22.763 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:46:22.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:46:22.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:46:22.768 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:46:22.822 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:46:22.831 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:46:22.831 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:46:22.834 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:46:22.836 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:46:22.859 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:46:22.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:46:22.981 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:46:23.066 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:46:23.107 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:46:23.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:46:23.172 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:46:23.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:46:23.358 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:46:23.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:46:23.442 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:46:23.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:46:23.507 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:46:23.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:46:23.602 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:46:23.687 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:46:23.728 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:46:23.733 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:46:23.795 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-09-19T08:46:23.798 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-19T08:46:23.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-09-19T08:46:23.840 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:46:23.846 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:46:23.887 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:46:24.363 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:46:24.371 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:46:24.371 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:46:24.423 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:46:24.458 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:46:24.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-09-19T08:46:24.523 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-09-19T08:46:24.525 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-09-19T08:46:24.581 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-09-19T08:46:24.583 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-09-19T08:46:24.635 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-09-19T08:46:24.637 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:46:24.637 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-09-19T08:46:24.659 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-09-19T08:46:24.660 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-09-19T08:46:24.700 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-09-19T08:46:24.700 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-09-19T08:46:24.735 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-09-19T08:46:24.735 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi083.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:46:24.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:46:24.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:46:24.765 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:46:24.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:46:24.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:46:24.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:46:24.820 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:46:24.820 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:46:24.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:46:24.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:46:24.930 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:46:24.941 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:46:24.961 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:46:24.962 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi122.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:50:10.379 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-09-19T08:50:10.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:50:10.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:50:10.461 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-19T08:50:10.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-19T08:50:10.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:50:10.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:50:10.611 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-19T08:50:10.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-19T08:50:10.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-19T08:50:10.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:50:10.768 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-19T08:50:10.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-19T08:50:10.850 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:50:10.860 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:50:10.861 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:50:10.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:50:10.864 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:50:10.864 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:50:10.866 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:50:10.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:50:10.894 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:50:10.895 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:50:10.909 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:50:10.912 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:50:10.918 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:50:10.933 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:50:10.934 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-09-19T08:50:10.937 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-09-19T08:50:10.946 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-09-19T08:50:10.948 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-09-19T08:50:10.957 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-09-19T08:50:10.960 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:50:10.963 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:50:10.968 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-09-19T08:50:10.974 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:50:10.977 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:50:10.982 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:50:10.997 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:50:11.030 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:50:11.033 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:50:11.033 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-19T08:50:11.033 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.033 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.033 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.033 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.046 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:50:11.049 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:50:11.050 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-19T08:50:11.050 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.050 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.050 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.050 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.052 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:50:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:50:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-09-19T08:50:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.055 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:50:11.056 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:50:11.065 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:50:11.065 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:50:11.065 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:50:11.066 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:50:11.072 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:50:11.073 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:50:11.073 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:50:11.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:50:11.076 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:50:11.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:50:11.077 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:50:11.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:50:11.229 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:50:11.229 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:50:11.233 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:50:11.233 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:50:11.235 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:50:11.236 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:50:11.339 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:50:11.339 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:50:11.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:50:11.349 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:50:11.349 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:50:11.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:50:11.352 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:50:11.352 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:50:11.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:50:11.365 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:50:11.365 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:50:11.375 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:50:11.375 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:50:11.379 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:50:11.379 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:50:11.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:50:11.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:50:11.445 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:50:11.506 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:50:11.516 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:50:11.520 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:50:11.570 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-09-19T08:50:11.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-09-19T08:50:11.579 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-09-19T08:50:11.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-09-19T08:50:11.584 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-09-19T08:50:11.586 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-09-19T08:50:11.807 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-09-19T08:50:11.811 INFO:teuthology.orchestra.run.smithi184.stdout:45 files removed 2024-09-19T08:50:11.813 INFO:teuthology.orchestra.run.smithi083.stdout:45 files removed 2024-09-19T08:50:11.833 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:50:11.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:50:11.840 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:50:12.389 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-19T08:50:12.393 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-19T08:50:12.402 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-19T08:50:12.656 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 53 kB/s | 12 kB 00:00 2024-09-19T08:50:12.686 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T08:50:12.686 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T08:50:12.914 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-19T08:50:12.953 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T08:50:12.961 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T08:50:13.470 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-19T08:50:15.398 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.3 MB 00:02 2024-09-19T08:50:16.186 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.3 MB 00:03 2024-09-19T08:50:16.213 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-19T08:50:18.155 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-19T08:50:20.698 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T08:50:22.098 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 19 kB 00:00 2024-09-19T08:50:23.128 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T08:50:24.173 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-19T08:50:25.647 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.5 MB 00:03 2024-09-19T08:50:27.181 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-19T08:50:28.093 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T08:50:28.451 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T08:50:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T08:50:30.124 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-19T08:50:30.637 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:50:30.638 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:50:30.652 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:50:30.653 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:50:30.654 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:50:30.655 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:50:30.657 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:50:30.660 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:50:30.661 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:50:30.724 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================== 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================== 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:50:30.734 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:50:30.735 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:50:30.736 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:50:30.737 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:50:30.738 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:50:30.739 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:50:30.740 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:50:30.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:50:30.742 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:50:30.743 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:50:30.744 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:50:30.745 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:50:30.746 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-19T08:50:30.747 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================== 2024-09-19T08:50:30.747 INFO:teuthology.orchestra.run.smithi083.stdout:Install 148 Packages 2024-09-19T08:50:30.747 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 8 Packages 2024-09-19T08:50:30.747 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:50:30.747 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 226 M 2024-09-19T08:50:30.747 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-19T08:50:30.995 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T08:50:31.127 INFO:teuthology.orchestra.run.smithi083.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-19T08:50:31.344 INFO:teuthology.orchestra.run.smithi083.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-19T08:50:31.411 INFO:teuthology.orchestra.run.smithi083.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T08:50:31.503 INFO:teuthology.orchestra.run.smithi083.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T08:50:31.637 INFO:teuthology.orchestra.run.smithi083.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-19T08:50:31.687 INFO:teuthology.orchestra.run.smithi083.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 8.7 MB/s | 2.4 MB 00:00 2024-09-19T08:50:31.920 INFO:teuthology.orchestra.run.smithi083.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T08:50:32.229 INFO:teuthology.orchestra.run.smithi083.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T08:50:32.263 INFO:teuthology.orchestra.run.smithi083.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 763 kB/s | 25 kB 00:00 2024-09-19T08:50:32.555 INFO:teuthology.orchestra.run.smithi083.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T08:50:32.613 INFO:teuthology.orchestra.run.smithi083.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T08:50:32.813 INFO:teuthology.orchestra.run.smithi083.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 15 MB/s | 17 MB 00:01 2024-09-19T08:50:32.830 INFO:teuthology.orchestra.run.smithi083.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 125 kB/s | 27 kB 00:00 2024-09-19T08:50:32.847 INFO:teuthology.orchestra.run.smithi083.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 947 kB/s | 32 kB 00:00 2024-09-19T08:50:32.889 INFO:teuthology.orchestra.run.smithi083.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 751 kB 00:00 2024-09-19T08:50:32.914 INFO:teuthology.orchestra.run.smithi083.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T08:50:32.957 INFO:teuthology.orchestra.run.smithi083.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.8 MB/s | 127 kB 00:00 2024-09-19T08:50:32.982 INFO:teuthology.orchestra.run.smithi083.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T08:50:33.057 INFO:teuthology.orchestra.run.smithi083.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 601 kB/s | 45 kB 00:00 2024-09-19T08:50:33.166 INFO:teuthology.orchestra.run.smithi083.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.2 MB/s | 136 kB 00:00 2024-09-19T08:50:33.241 INFO:teuthology.orchestra.run.smithi083.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-19T08:50:33.266 INFO:teuthology.orchestra.run.smithi083.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.6 MB/s | 161 kB 00:00 2024-09-19T08:50:33.292 INFO:teuthology.orchestra.run.smithi083.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T08:50:33.317 INFO:teuthology.orchestra.run.smithi083.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T08:50:33.351 INFO:teuthology.orchestra.run.smithi083.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.6 MB/s | 99 kB 00:00 2024-09-19T08:50:33.376 INFO:teuthology.orchestra.run.smithi083.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T08:50:33.443 INFO:teuthology.orchestra.run.smithi083.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T08:50:33.491 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-19T08:50:33.493 INFO:teuthology.orchestra.run.smithi083.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-19T08:50:33.510 INFO:teuthology.orchestra.run.smithi083.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 475 kB/s | 32 kB 00:00 2024-09-19T08:50:33.544 INFO:teuthology.orchestra.run.smithi083.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T08:50:33.770 INFO:teuthology.orchestra.run.smithi083.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 14 MB/s | 3.6 MB 00:00 2024-09-19T08:50:33.820 INFO:teuthology.orchestra.run.smithi083.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T08:50:33.945 INFO:teuthology.orchestra.run.smithi083.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-19T08:50:33.962 INFO:teuthology.orchestra.run.smithi083.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 347 kB/s | 49 kB 00:00 2024-09-19T08:50:33.987 INFO:teuthology.orchestra.run.smithi083.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 393 kB/s | 16 kB 00:00 2024-09-19T08:50:34.012 INFO:teuthology.orchestra.run.smithi083.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T08:50:34.063 INFO:teuthology.orchestra.run.smithi083.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-19T08:50:34.079 INFO:teuthology.orchestra.run.smithi083.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 272 kB/s | 18 kB 00:00 2024-09-19T08:50:34.522 INFO:teuthology.orchestra.run.smithi083.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 22 MB/s | 49 MB 00:02 2024-09-19T08:50:34.630 INFO:teuthology.orchestra.run.smithi083.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 141 kB/s | 80 kB 00:00 2024-09-19T08:50:34.723 INFO:teuthology.orchestra.run.smithi083.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 956 kB/s | 191 kB 00:00 2024-09-19T08:50:34.756 INFO:teuthology.orchestra.run.smithi083.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-19T08:50:34.790 INFO:teuthology.orchestra.run.smithi083.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-19T08:50:34.815 INFO:teuthology.orchestra.run.smithi083.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T08:50:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T08:50:34.874 INFO:teuthology.orchestra.run.smithi083.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T08:50:34.899 INFO:teuthology.orchestra.run.smithi083.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T08:50:34.941 INFO:teuthology.orchestra.run.smithi083.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-19T08:50:35.083 INFO:teuthology.orchestra.run.smithi083.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-19T08:50:35.108 INFO:teuthology.orchestra.run.smithi083.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-19T08:50:35.134 INFO:teuthology.orchestra.run.smithi083.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-19T08:50:35.176 INFO:teuthology.orchestra.run.smithi083.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-19T08:50:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 486 kB/s | 33 kB 00:00 2024-09-19T08:50:35.243 INFO:teuthology.orchestra.run.smithi083.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-19T08:50:35.268 INFO:teuthology.orchestra.run.smithi083.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-19T08:50:35.294 INFO:teuthology.orchestra.run.smithi083.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi083.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T08:50:35.344 INFO:teuthology.orchestra.run.smithi083.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-19T08:50:35.411 INFO:teuthology.orchestra.run.smithi083.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T08:50:35.436 INFO:teuthology.orchestra.run.smithi083.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-19T08:50:35.453 INFO:teuthology.orchestra.run.smithi083.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 585 kB/s | 24 kB 00:00 2024-09-19T08:50:35.479 INFO:teuthology.orchestra.run.smithi083.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-19T08:50:35.496 INFO:teuthology.orchestra.run.smithi083.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-19T08:50:35.521 INFO:teuthology.orchestra.run.smithi083.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T08:50:35.538 INFO:teuthology.orchestra.run.smithi083.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 921 kB/s | 38 kB 00:00 2024-09-19T08:50:35.563 INFO:teuthology.orchestra.run.smithi083.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T08:50:35.681 INFO:teuthology.orchestra.run.smithi083.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-19T08:50:35.712 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:50:35.713 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:50:35.722 INFO:teuthology.orchestra.run.smithi083.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-19T08:50:35.726 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:50:35.727 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:50:35.728 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:50:35.729 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:50:35.731 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:50:35.734 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:50:35.735 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:50:35.756 INFO:teuthology.orchestra.run.smithi083.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-19T08:50:35.781 INFO:teuthology.orchestra.run.smithi083.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T08:50:35.801 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-19T08:50:35.817 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:50:35.818 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:50:35.819 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:50:35.820 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-19T08:50:35.821 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:50:35.822 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:50:35.823 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:50:35.825 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:50:35.826 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:50:35.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:50:35.828 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:50:35.829 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout:Install 148 Packages 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 8 Packages 2024-09-19T08:50:35.830 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:50:35.831 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 226 M 2024-09-19T08:50:35.831 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-19T08:50:35.857 INFO:teuthology.orchestra.run.smithi083.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T08:50:35.890 INFO:teuthology.orchestra.run.smithi083.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-19T08:50:35.916 INFO:teuthology.orchestra.run.smithi083.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:50:35.949 INFO:teuthology.orchestra.run.smithi083.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-19T08:50:36.033 INFO:teuthology.orchestra.run.smithi083.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-19T08:50:36.058 INFO:teuthology.orchestra.run.smithi083.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T08:50:36.092 INFO:teuthology.orchestra.run.smithi083.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T08:50:36.117 INFO:teuthology.orchestra.run.smithi083.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-19T08:50:36.143 INFO:teuthology.orchestra.run.smithi083.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 379 kB/s | 19 kB 00:00 2024-09-19T08:50:36.168 INFO:teuthology.orchestra.run.smithi083.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T08:50:36.193 INFO:teuthology.orchestra.run.smithi083.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-19T08:50:36.293 INFO:teuthology.orchestra.run.smithi083.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T08:50:36.318 INFO:teuthology.orchestra.run.smithi083.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-19T08:50:36.352 INFO:teuthology.orchestra.run.smithi083.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T08:50:36.377 INFO:teuthology.orchestra.run.smithi083.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T08:50:36.403 INFO:teuthology.orchestra.run.smithi083.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-19T08:50:36.425 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-19T08:50:36.436 INFO:teuthology.orchestra.run.smithi083.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T08:50:36.462 INFO:teuthology.orchestra.run.smithi083.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T08:50:36.487 INFO:teuthology.orchestra.run.smithi083.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T08:50:36.512 INFO:teuthology.orchestra.run.smithi083.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:50:36.541 INFO:teuthology.orchestra.run.smithi083.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:50:36.609 INFO:teuthology.orchestra.run.smithi122.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-19T08:50:36.613 INFO:teuthology.orchestra.run.smithi083.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-19T08:50:36.638 INFO:teuthology.orchestra.run.smithi083.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-19T08:50:36.663 INFO:teuthology.orchestra.run.smithi083.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-19T08:50:36.689 INFO:teuthology.orchestra.run.smithi083.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi083.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-19T08:50:36.739 INFO:teuthology.orchestra.run.smithi083.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-19T08:50:36.764 INFO:teuthology.orchestra.run.smithi083.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-19T08:50:36.781 INFO:teuthology.orchestra.run.smithi083.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T08:50:36.801 INFO:teuthology.orchestra.run.smithi122.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-19T08:50:36.806 INFO:teuthology.orchestra.run.smithi083.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-19T08:50:36.824 INFO:teuthology.orchestra.run.smithi083.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-19T08:50:36.849 INFO:teuthology.orchestra.run.smithi083.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T08:50:36.868 INFO:teuthology.orchestra.run.smithi122.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T08:50:36.960 INFO:teuthology.orchestra.run.smithi122.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T08:50:37.085 INFO:teuthology.orchestra.run.smithi122.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-19T08:50:37.116 INFO:teuthology.orchestra.run.smithi083.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-19T08:50:37.135 INFO:teuthology.orchestra.run.smithi122.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 8.9 MB/s | 2.4 MB 00:00 2024-09-19T08:50:37.166 INFO:teuthology.orchestra.run.smithi083.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:50:37.191 INFO:teuthology.orchestra.run.smithi083.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-19T08:50:37.243 INFO:teuthology.orchestra.run.smithi083.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 439 kB/s | 19 kB 00:00 2024-09-19T08:50:37.367 INFO:teuthology.orchestra.run.smithi083.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 36 MB/s | 4.4 MB 00:00 2024-09-19T08:50:37.369 INFO:teuthology.orchestra.run.smithi122.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T08:50:37.384 INFO:teuthology.orchestra.run.smithi083.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T08:50:37.401 INFO:teuthology.orchestra.run.smithi083.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-19T08:50:37.426 INFO:teuthology.orchestra.run.smithi083.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:50:37.452 INFO:teuthology.orchestra.run.smithi083.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T08:50:37.502 INFO:teuthology.orchestra.run.smithi083.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T08:50:37.535 INFO:teuthology.orchestra.run.smithi083.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T08:50:37.553 INFO:teuthology.orchestra.run.smithi083.stdout:(114/156): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-19T08:50:37.570 INFO:teuthology.orchestra.run.smithi083.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-19T08:50:37.595 INFO:teuthology.orchestra.run.smithi083.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 791 kB/s | 14 kB 00:00 2024-09-19T08:50:37.620 INFO:teuthology.orchestra.run.smithi083.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 7.3 MB/s | 172 kB 00:00 2024-09-19T08:50:37.637 INFO:teuthology.orchestra.run.smithi083.stdout:(118/156): python3-cachetools-4.2.4-1.el9.noarc 383 kB/s | 32 kB 00:00 2024-09-19T08:50:37.671 INFO:teuthology.orchestra.run.smithi083.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T08:50:37.705 INFO:teuthology.orchestra.run.smithi083.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T08:50:37.720 INFO:teuthology.orchestra.run.smithi122.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T08:50:37.730 INFO:teuthology.orchestra.run.smithi083.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T08:50:37.755 INFO:teuthology.orchestra.run.smithi083.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T08:50:37.761 INFO:teuthology.orchestra.run.smithi122.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T08:50:37.780 INFO:teuthology.orchestra.run.smithi083.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T08:50:37.806 INFO:teuthology.orchestra.run.smithi083.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-19T08:50:37.831 INFO:teuthology.orchestra.run.smithi083.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-19T08:50:37.856 INFO:teuthology.orchestra.run.smithi083.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-19T08:50:37.881 INFO:teuthology.orchestra.run.smithi083.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-19T08:50:37.915 INFO:teuthology.orchestra.run.smithi083.stdout:(128/156): protobuf-compiler-3.14.0-13.el9.x86_ 810 kB/s | 863 kB 00:01 2024-09-19T08:50:37.957 INFO:teuthology.orchestra.run.smithi083.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-19T08:50:37.987 INFO:teuthology.orchestra.run.smithi122.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T08:50:37.999 INFO:teuthology.orchestra.run.smithi083.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-19T08:50:38.024 INFO:teuthology.orchestra.run.smithi083.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-19T08:50:38.037 INFO:teuthology.orchestra.run.smithi122.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T08:50:38.075 INFO:teuthology.orchestra.run.smithi083.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-19T08:50:38.100 INFO:teuthology.orchestra.run.smithi083.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-09-19T08:50:38.125 INFO:teuthology.orchestra.run.smithi083.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-19T08:50:38.150 INFO:teuthology.orchestra.run.smithi083.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:50:38.176 INFO:teuthology.orchestra.run.smithi083.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T08:50:38.193 INFO:teuthology.orchestra.run.smithi083.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 729 kB/s | 31 kB 00:00 2024-09-19T08:50:38.218 INFO:teuthology.orchestra.run.smithi083.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-19T08:50:38.236 INFO:teuthology.orchestra.run.smithi083.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-19T08:50:38.237 INFO:teuthology.orchestra.run.smithi122.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 15 MB/s | 17 MB 00:01 2024-09-19T08:50:38.252 INFO:teuthology.orchestra.run.smithi083.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-19T08:50:38.262 INFO:teuthology.orchestra.run.smithi122.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 120 kB/s | 27 kB 00:00 2024-09-19T08:50:38.277 INFO:teuthology.orchestra.run.smithi083.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T08:50:38.288 INFO:teuthology.orchestra.run.smithi122.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T08:50:38.303 INFO:teuthology.orchestra.run.smithi083.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-19T08:50:38.321 INFO:teuthology.orchestra.run.smithi122.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T08:50:38.328 INFO:teuthology.orchestra.run.smithi083.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:50:38.347 INFO:teuthology.orchestra.run.smithi122.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T08:50:38.353 INFO:teuthology.orchestra.run.smithi083.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:50:38.370 INFO:teuthology.orchestra.run.smithi083.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-09-19T08:50:38.372 INFO:teuthology.orchestra.run.smithi122.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T08:50:38.395 INFO:teuthology.orchestra.run.smithi083.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T08:50:38.397 INFO:teuthology.orchestra.run.smithi122.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 9.8 MB/s | 506 kB 00:00 2024-09-19T08:50:38.421 INFO:teuthology.orchestra.run.smithi083.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T08:50:38.471 INFO:teuthology.orchestra.run.smithi083.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T08:50:38.481 INFO:teuthology.orchestra.run.smithi122.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 542 kB/s | 45 kB 00:00 2024-09-19T08:50:38.598 INFO:teuthology.orchestra.run.smithi122.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 24 MB/s | 5.3 MB 00:00 2024-09-19T08:50:38.602 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:50:38.603 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:50:38.614 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:50:38.615 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:50:38.615 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:50:38.616 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:50:38.618 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:50:38.620 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:50:38.621 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:50:38.623 INFO:teuthology.orchestra.run.smithi122.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 958 kB/s | 136 kB 00:00 2024-09-19T08:50:38.649 INFO:teuthology.orchestra.run.smithi122.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T08:50:38.674 INFO:teuthology.orchestra.run.smithi122.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T08:50:38.682 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:50:38.702 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:50:38.703 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:50:38.704 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:50:38.705 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:50:38.706 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:50:38.707 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:50:38.708 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:50:38.709 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:50:38.710 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:50:38.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:50:38.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:50:38.713 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout:Install 148 Packages 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 8 Packages 2024-09-19T08:50:38.714 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:50:38.715 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 226 M 2024-09-19T08:50:38.715 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-19T08:50:38.724 INFO:teuthology.orchestra.run.smithi122.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T08:50:38.758 INFO:teuthology.orchestra.run.smithi122.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T08:50:38.788 INFO:teuthology.orchestra.run.smithi083.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-19T08:50:38.800 INFO:teuthology.orchestra.run.smithi122.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T08:50:38.838 INFO:teuthology.orchestra.run.smithi083.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-19T08:50:38.883 INFO:teuthology.orchestra.run.smithi083.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 5.6 MB/s | 2.3 MB 00:00 2024-09-19T08:50:38.901 INFO:teuthology.orchestra.run.smithi122.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T08:50:38.908 INFO:teuthology.orchestra.run.smithi083.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 590 kB/s | 41 kB 00:00 2024-09-19T08:50:38.934 INFO:teuthology.orchestra.run.smithi083.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.8 MB/s | 249 kB 00:00 2024-09-19T08:50:38.967 INFO:teuthology.orchestra.run.smithi122.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-19T08:50:38.993 INFO:teuthology.orchestra.run.smithi122.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 346 kB/s | 32 kB 00:00 2024-09-19T08:50:39.018 INFO:teuthology.orchestra.run.smithi122.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi083.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.1 MB/s | 1.8 MB 00:00 2024-09-19T08:50:39.137 INFO:teuthology.orchestra.run.smithi083.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-19T08:50:39.234 INFO:teuthology.orchestra.run.smithi083.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.0 MB/s | 2.4 MB 00:00 2024-09-19T08:50:39.241 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:39.241 INFO:teuthology.orchestra.run.smithi083.stdout:Total 27 MB/s | 226 MB 00:08 2024-09-19T08:50:39.343 INFO:teuthology.orchestra.run.smithi184.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 26 kB/s | 6.6 kB 00:00 2024-09-19T08:50:39.368 INFO:teuthology.orchestra.run.smithi122.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-19T08:50:39.443 INFO:teuthology.orchestra.run.smithi122.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.9 MB/s | 3.6 MB 00:00 2024-09-19T08:50:39.469 INFO:teuthology.orchestra.run.smithi122.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T08:50:39.494 INFO:teuthology.orchestra.run.smithi122.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 983 kB/s | 49 kB 00:00 2024-09-19T08:50:39.520 INFO:teuthology.orchestra.run.smithi122.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 327 kB/s | 16 kB 00:00 2024-09-19T08:50:39.545 INFO:teuthology.orchestra.run.smithi122.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T08:50:39.578 INFO:teuthology.orchestra.run.smithi122.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T08:50:39.604 INFO:teuthology.orchestra.run.smithi122.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 310 kB/s | 18 kB 00:00 2024-09-19T08:50:39.652 INFO:teuthology.orchestra.run.smithi184.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.8 MB/s | 896 kB 00:00 2024-09-19T08:50:39.744 INFO:teuthology.orchestra.run.smithi184.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T08:50:40.094 INFO:teuthology.orchestra.run.smithi184.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 2.4 MB 00:00 2024-09-19T08:50:40.162 INFO:teuthology.orchestra.run.smithi122.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 20 MB/s | 49 MB 00:02 2024-09-19T08:50:40.169 INFO:teuthology.orchestra.run.smithi184.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 5.0 MB/s | 5.4 MB 00:01 2024-09-19T08:50:40.188 INFO:teuthology.orchestra.run.smithi122.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 131 kB/s | 80 kB 00:00 2024-09-19T08:50:40.295 INFO:teuthology.orchestra.run.smithi184.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-19T08:50:40.304 INFO:teuthology.orchestra.run.smithi122.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-19T08:50:40.363 INFO:teuthology.orchestra.run.smithi122.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-19T08:50:40.388 INFO:teuthology.orchestra.run.smithi122.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 848 kB/s | 191 kB 00:00 2024-09-19T08:50:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-19T08:50:40.455 INFO:teuthology.orchestra.run.smithi122.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-19T08:50:40.475 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-19T08:50:40.481 INFO:teuthology.orchestra.run.smithi122.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-19T08:50:40.495 INFO:teuthology.orchestra.run.smithi184.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi122.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-19T08:50:40.548 INFO:teuthology.orchestra.run.smithi122.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-19T08:50:40.626 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-19T08:50:40.626 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-19T08:50:40.674 INFO:teuthology.orchestra.run.smithi122.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 855 kB/s | 107 kB 00:00 2024-09-19T08:50:40.699 INFO:teuthology.orchestra.run.smithi122.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-19T08:50:40.724 INFO:teuthology.orchestra.run.smithi122.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-19T08:50:40.749 INFO:teuthology.orchestra.run.smithi122.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T08:50:40.775 INFO:teuthology.orchestra.run.smithi122.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-19T08:50:40.817 INFO:teuthology.orchestra.run.smithi122.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-19T08:50:40.834 INFO:teuthology.orchestra.run.smithi122.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-19T08:50:40.851 INFO:teuthology.orchestra.run.smithi122.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-19T08:50:40.876 INFO:teuthology.orchestra.run.smithi122.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-19T08:50:40.893 INFO:teuthology.orchestra.run.smithi122.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T08:50:40.935 INFO:teuthology.orchestra.run.smithi122.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T08:50:40.977 INFO:teuthology.orchestra.run.smithi122.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 591 kB/s | 24 kB 00:00 2024-09-19T08:50:41.027 INFO:teuthology.orchestra.run.smithi122.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-19T08:50:41.052 INFO:teuthology.orchestra.run.smithi122.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-19T08:50:41.086 INFO:teuthology.orchestra.run.smithi122.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T08:50:41.111 INFO:teuthology.orchestra.run.smithi122.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.6 MB/s | 581 kB 00:00 2024-09-19T08:50:41.128 INFO:teuthology.orchestra.run.smithi184.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 17 MB/s | 11 MB 00:00 2024-09-19T08:50:41.136 INFO:teuthology.orchestra.run.smithi122.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-19T08:50:41.162 INFO:teuthology.orchestra.run.smithi122.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T08:50:41.262 INFO:teuthology.orchestra.run.smithi122.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T08:50:41.304 INFO:teuthology.orchestra.run.smithi122.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T08:50:41.345 INFO:teuthology.orchestra.run.smithi184.stdout:(9/156): ceph-common-19.1.1-361.g2f599a46.el9.x 9.4 MB/s | 21 MB 00:02 2024-09-19T08:50:41.370 INFO:teuthology.orchestra.run.smithi184.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 104 kB/s | 25 kB 00:00 2024-09-19T08:50:41.371 INFO:teuthology.orchestra.run.smithi122.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-19T08:50:41.396 INFO:teuthology.orchestra.run.smithi122.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T08:50:41.460 INFO:teuthology.orchestra.run.smithi122.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.5 MB/s | 910 kB 00:00 2024-09-19T08:50:41.497 INFO:teuthology.orchestra.run.smithi122.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-19T08:50:41.522 INFO:teuthology.orchestra.run.smithi122.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.4 MB/s | 87 kB 00:00 2024-09-19T08:50:41.564 INFO:teuthology.orchestra.run.smithi122.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T08:50:41.579 INFO:teuthology.orchestra.run.smithi184.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 13 MB/s | 17 MB 00:01 2024-09-19T08:50:41.604 INFO:teuthology.orchestra.run.smithi184.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 976 kB/s | 228 kB 00:00 2024-09-19T08:50:41.630 INFO:teuthology.orchestra.run.smithi184.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 540 kB/s | 27 kB 00:00 2024-09-19T08:50:41.655 INFO:teuthology.orchestra.run.smithi184.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T08:50:41.656 INFO:teuthology.orchestra.run.smithi122.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-19T08:50:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-19T08:50:41.707 INFO:teuthology.orchestra.run.smithi122.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T08:50:41.713 INFO:teuthology.orchestra.run.smithi184.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T08:50:41.732 INFO:teuthology.orchestra.run.smithi122.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-19T08:50:41.739 INFO:teuthology.orchestra.run.smithi184.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T08:50:41.757 INFO:teuthology.orchestra.run.smithi122.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T08:50:41.783 INFO:teuthology.orchestra.run.smithi122.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T08:50:41.789 INFO:teuthology.orchestra.run.smithi184.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T08:50:41.808 INFO:teuthology.orchestra.run.smithi122.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T08:50:41.814 INFO:teuthology.orchestra.run.smithi184.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T08:50:41.881 INFO:teuthology.orchestra.run.smithi184.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 678 kB/s | 45 kB 00:00 2024-09-19T08:50:41.892 INFO:teuthology.orchestra.run.smithi122.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T08:50:41.917 INFO:teuthology.orchestra.run.smithi122.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T08:50:41.942 INFO:teuthology.orchestra.run.smithi122.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:50:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T08:50:41.968 INFO:teuthology.orchestra.run.smithi122.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:50:41.993 INFO:teuthology.orchestra.run.smithi122.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-19T08:50:42.018 INFO:teuthology.orchestra.run.smithi122.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T08:50:42.032 INFO:teuthology.orchestra.run.smithi184.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T08:50:42.043 INFO:teuthology.orchestra.run.smithi122.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T08:50:42.069 INFO:teuthology.orchestra.run.smithi122.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T08:50:42.094 INFO:teuthology.orchestra.run.smithi122.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:50:42.119 INFO:teuthology.orchestra.run.smithi122.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:50:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-19T08:50:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.2 MB/s | 320 kB 00:00 2024-09-19T08:50:42.195 INFO:teuthology.orchestra.run.smithi122.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T08:50:42.199 INFO:teuthology.orchestra.run.smithi184.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T08:50:42.211 INFO:teuthology.orchestra.run.smithi122.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-19T08:50:42.225 INFO:teuthology.orchestra.run.smithi184.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T08:50:42.228 INFO:teuthology.orchestra.run.smithi122.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T08:50:42.250 INFO:teuthology.orchestra.run.smithi184.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:50:42.254 INFO:teuthology.orchestra.run.smithi122.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-19T08:50:42.271 INFO:teuthology.orchestra.run.smithi122.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 860 kB/s | 36 kB 00:00 2024-09-19T08:50:42.287 INFO:teuthology.orchestra.run.smithi122.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T08:50:42.300 INFO:teuthology.orchestra.run.smithi184.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T08:50:42.330 INFO:teuthology.orchestra.run.smithi122.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T08:50:42.355 INFO:teuthology.orchestra.run.smithi122.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 861 kB/s | 58 kB 00:00 2024-09-19T08:50:42.380 INFO:teuthology.orchestra.run.smithi122.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T08:50:42.384 INFO:teuthology.orchestra.run.smithi184.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T08:50:42.401 INFO:teuthology.orchestra.run.smithi184.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 318 kB/s | 32 kB 00:00 2024-09-19T08:50:42.405 INFO:teuthology.orchestra.run.smithi122.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T08:50:42.431 INFO:teuthology.orchestra.run.smithi122.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T08:50:42.435 INFO:teuthology.orchestra.run.smithi184.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T08:50:42.656 INFO:teuthology.orchestra.run.smithi122.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-19T08:50:42.693 INFO:teuthology.orchestra.run.smithi184.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T08:50:42.706 INFO:teuthology.orchestra.run.smithi122.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:50:42.740 INFO:teuthology.orchestra.run.smithi122.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T08:50:42.743 INFO:teuthology.orchestra.run.smithi184.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T08:50:42.774 INFO:teuthology.orchestra.run.smithi122.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 581 kB/s | 19 kB 00:00 2024-09-19T08:50:42.811 INFO:teuthology.orchestra.run.smithi184.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 742 kB/s | 49 kB 00:00 2024-09-19T08:50:42.874 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-19T08:50:42.875 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-19T08:50:42.886 INFO:teuthology.orchestra.run.smithi184.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-19T08:50:42.902 INFO:teuthology.orchestra.run.smithi184.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 179 kB/s | 16 kB 00:00 2024-09-19T08:50:42.907 INFO:teuthology.orchestra.run.smithi122.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-19T08:50:42.933 INFO:teuthology.orchestra.run.smithi122.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-19T08:50:42.936 INFO:teuthology.orchestra.run.smithi184.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T08:50:42.958 INFO:teuthology.orchestra.run.smithi122.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T08:50:42.978 INFO:teuthology.orchestra.run.smithi184.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-19T08:50:42.983 INFO:teuthology.orchestra.run.smithi122.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:50:43.003 INFO:teuthology.orchestra.run.smithi184.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 272 kB/s | 18 kB 00:00 2024-09-19T08:50:43.008 INFO:teuthology.orchestra.run.smithi122.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T08:50:43.050 INFO:teuthology.orchestra.run.smithi122.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T08:50:43.092 INFO:teuthology.orchestra.run.smithi122.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T08:50:43.117 INFO:teuthology.orchestra.run.smithi122.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:50:43.143 INFO:teuthology.orchestra.run.smithi122.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:50:43.168 INFO:teuthology.orchestra.run.smithi122.stdout:(116/156): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-09-19T08:50:43.193 INFO:teuthology.orchestra.run.smithi122.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 287 kB/s | 14 kB 00:00 2024-09-19T08:50:43.227 INFO:teuthology.orchestra.run.smithi122.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 13 MB/s | 358 kB 00:00 2024-09-19T08:50:43.261 INFO:teuthology.orchestra.run.smithi122.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.4 MB/s | 303 kB 00:00 2024-09-19T08:50:43.286 INFO:teuthology.orchestra.run.smithi122.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T08:50:43.311 INFO:teuthology.orchestra.run.smithi122.stdout:(121/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2024-09-19T08:50:43.354 INFO:teuthology.orchestra.run.smithi122.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-19T08:50:43.379 INFO:teuthology.orchestra.run.smithi122.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-19T08:50:43.404 INFO:teuthology.orchestra.run.smithi122.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 703 kB/s | 18 kB 00:00 2024-09-19T08:50:43.429 INFO:teuthology.orchestra.run.smithi122.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-19T08:50:43.454 INFO:teuthology.orchestra.run.smithi184.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T08:50:43.454 INFO:teuthology.orchestra.run.smithi122.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-19T08:50:43.479 INFO:teuthology.orchestra.run.smithi184.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 159 kB/s | 80 kB 00:00 2024-09-19T08:50:43.480 INFO:teuthology.orchestra.run.smithi122.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-19T08:50:43.522 INFO:teuthology.orchestra.run.smithi122.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T08:50:43.547 INFO:teuthology.orchestra.run.smithi122.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:50:43.562 INFO:teuthology.orchestra.run.smithi184.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-19T08:50:43.581 INFO:teuthology.orchestra.run.smithi122.stdout:(130/156): protobuf-compiler-3.14.0-13.el9.x86_ 751 kB/s | 863 kB 00:01 2024-09-19T08:50:43.588 INFO:teuthology.orchestra.run.smithi184.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T08:50:43.606 INFO:teuthology.orchestra.run.smithi122.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-19T08:50:43.613 INFO:teuthology.orchestra.run.smithi184.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T08:50:43.638 INFO:teuthology.orchestra.run.smithi184.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T08:50:43.648 INFO:teuthology.orchestra.run.smithi122.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 7.9 MB/s | 272 kB 00:00 2024-09-19T08:50:43.664 INFO:teuthology.orchestra.run.smithi184.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T08:50:43.665 INFO:teuthology.orchestra.run.smithi122.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 1.1 MB/s | 16 kB 00:00 2024-09-19T08:50:43.689 INFO:teuthology.orchestra.run.smithi184.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T08:50:43.692 INFO:teuthology.orchestra.run.smithi122.stdout:(134/156): python3-natsort-7.1.1-5.el9.noarch.r 521 kB/s | 58 kB 00:00 2024-09-19T08:50:43.714 INFO:teuthology.orchestra.run.smithi184.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T08:50:43.717 INFO:teuthology.orchestra.run.smithi122.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:50:43.743 INFO:teuthology.orchestra.run.smithi122.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-09-19T08:50:43.748 INFO:teuthology.orchestra.run.smithi184.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-19T08:50:43.768 INFO:teuthology.orchestra.run.smithi122.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T08:50:43.801 INFO:teuthology.orchestra.run.smithi122.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-09-19T08:50:43.827 INFO:teuthology.orchestra.run.smithi122.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T08:50:43.852 INFO:teuthology.orchestra.run.smithi122.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T08:50:43.877 INFO:teuthology.orchestra.run.smithi122.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-19T08:50:43.881 INFO:teuthology.orchestra.run.smithi184.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-19T08:50:43.903 INFO:teuthology.orchestra.run.smithi122.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T08:50:43.906 INFO:teuthology.orchestra.run.smithi184.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-19T08:50:43.924 INFO:teuthology.orchestra.run.smithi184.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-09-19T08:50:43.928 INFO:teuthology.orchestra.run.smithi122.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:50:43.953 INFO:teuthology.orchestra.run.smithi122.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:50:43.957 INFO:teuthology.orchestra.run.smithi184.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-19T08:50:43.974 INFO:teuthology.orchestra.run.smithi184.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-19T08:50:43.978 INFO:teuthology.orchestra.run.smithi122.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T08:50:43.999 INFO:teuthology.orchestra.run.smithi184.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T08:50:44.004 INFO:teuthology.orchestra.run.smithi122.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:50:44.016 INFO:teuthology.orchestra.run.smithi184.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-19T08:50:44.029 INFO:teuthology.orchestra.run.smithi122.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T08:50:44.033 INFO:teuthology.orchestra.run.smithi184.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-19T08:50:44.079 INFO:teuthology.orchestra.run.smithi122.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T08:50:44.092 INFO:teuthology.orchestra.run.smithi184.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-19T08:50:44.109 INFO:teuthology.orchestra.run.smithi184.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-19T08:50:44.134 INFO:teuthology.orchestra.run.smithi184.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-19T08:50:44.176 INFO:teuthology.orchestra.run.smithi184.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-19T08:50:44.193 INFO:teuthology.orchestra.run.smithi184.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-19T08:50:44.218 INFO:teuthology.orchestra.run.smithi184.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-19T08:50:44.235 INFO:teuthology.orchestra.run.smithi184.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-19T08:50:44.269 INFO:teuthology.orchestra.run.smithi184.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T08:50:44.280 INFO:teuthology.orchestra.run.smithi122.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T08:50:44.294 INFO:teuthology.orchestra.run.smithi184.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T08:50:44.311 INFO:teuthology.orchestra.run.smithi184.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-19T08:50:44.347 INFO:teuthology.orchestra.run.smithi122.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T08:50:44.378 INFO:teuthology.orchestra.run.smithi184.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T08:50:44.453 INFO:teuthology.orchestra.run.smithi184.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-19T08:50:44.463 INFO:teuthology.orchestra.run.smithi122.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 351 kB/s | 41 kB 00:00 2024-09-19T08:50:44.487 INFO:teuthology.orchestra.run.smithi184.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-19T08:50:44.554 INFO:teuthology.orchestra.run.smithi184.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-19T08:50:44.579 INFO:teuthology.orchestra.run.smithi184.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T08:50:44.589 INFO:teuthology.orchestra.run.smithi122.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T08:50:44.613 INFO:teuthology.orchestra.run.smithi184.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-19T08:50:44.637 INFO:teuthology.orchestra.run.smithi184.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:50:44.680 INFO:teuthology.orchestra.run.smithi184.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T08:50:44.689 INFO:teuthology.orchestra.run.smithi122.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.4 MB/s | 1.8 MB 00:00 2024-09-19T08:50:44.755 INFO:teuthology.orchestra.run.smithi184.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-19T08:50:44.780 INFO:teuthology.orchestra.run.smithi184.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T08:50:44.805 INFO:teuthology.orchestra.run.smithi184.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T08:50:44.831 INFO:teuthology.orchestra.run.smithi122.stdout:(154/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.1 MB/s | 2.3 MB 00:00 2024-09-19T08:50:44.839 INFO:teuthology.orchestra.run.smithi184.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-09-19T08:50:44.864 INFO:teuthology.orchestra.run.smithi184.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-19T08:50:44.890 INFO:teuthology.orchestra.run.smithi184.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T08:50:44.906 INFO:teuthology.orchestra.run.smithi122.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-19T08:50:44.917 INFO:teuthology.orchestra.run.smithi184.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-19T08:50:44.948 INFO:teuthology.orchestra.run.smithi122.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 1.4 MB 00:00 2024-09-19T08:50:44.955 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:44.955 INFO:teuthology.orchestra.run.smithi122.stdout:Total 25 MB/s | 226 MB 00:09 2024-09-19T08:50:44.990 INFO:teuthology.orchestra.run.smithi184.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-19T08:50:45.016 INFO:teuthology.orchestra.run.smithi184.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-19T08:50:45.041 INFO:teuthology.orchestra.run.smithi184.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:50:45.066 INFO:teuthology.orchestra.run.smithi184.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:50:45.091 INFO:teuthology.orchestra.run.smithi184.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-19T08:50:45.117 INFO:teuthology.orchestra.run.smithi184.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T08:50:45.142 INFO:teuthology.orchestra.run.smithi184.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T08:50:45.167 INFO:teuthology.orchestra.run.smithi184.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T08:50:45.193 INFO:teuthology.orchestra.run.smithi184.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:50:45.217 INFO:teuthology.orchestra.run.smithi184.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:50:45.301 INFO:teuthology.orchestra.run.smithi184.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T08:50:45.318 INFO:teuthology.orchestra.run.smithi184.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-19T08:50:45.343 INFO:teuthology.orchestra.run.smithi184.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T08:50:45.369 INFO:teuthology.orchestra.run.smithi184.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T08:50:45.385 INFO:teuthology.orchestra.run.smithi184.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-09-19T08:50:45.411 INFO:teuthology.orchestra.run.smithi184.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T08:50:45.453 INFO:teuthology.orchestra.run.smithi184.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T08:50:45.478 INFO:teuthology.orchestra.run.smithi184.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-19T08:50:45.503 INFO:teuthology.orchestra.run.smithi184.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T08:50:45.520 INFO:teuthology.orchestra.run.smithi184.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-19T08:50:45.546 INFO:teuthology.orchestra.run.smithi184.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T08:50:45.562 INFO:teuthology.orchestra.run.smithi184.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 531 kB/s | 22 kB 00:00 2024-09-19T08:50:45.721 INFO:teuthology.orchestra.run.smithi184.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T08:50:45.779 INFO:teuthology.orchestra.run.smithi184.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-19T08:50:45.822 INFO:teuthology.orchestra.run.smithi184.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-09-19T08:50:45.847 INFO:teuthology.orchestra.run.smithi184.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-19T08:50:45.863 INFO:teuthology.orchestra.run.smithi184.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 237 kB/s | 19 kB 00:00 2024-09-19T08:50:45.880 INFO:teuthology.orchestra.run.smithi184.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 774 kB/s | 26 kB 00:00 2024-09-19T08:50:45.898 INFO:teuthology.orchestra.run.smithi184.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T08:50:45.923 INFO:teuthology.orchestra.run.smithi184.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-19T08:50:45.956 INFO:teuthology.orchestra.run.smithi184.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-19T08:50:45.998 INFO:teuthology.orchestra.run.smithi184.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T08:50:46.015 INFO:teuthology.orchestra.run.smithi184.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T08:50:46.041 INFO:teuthology.orchestra.run.smithi184.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:50:46.057 INFO:teuthology.orchestra.run.smithi184.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 855 kB/s | 14 kB 00:00 2024-09-19T08:50:46.120 INFO:teuthology.orchestra.run.smithi184.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.3 MB/s | 548 kB 00:00 2024-09-19T08:50:46.150 INFO:teuthology.orchestra.run.smithi184.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-19T08:50:46.183 INFO:teuthology.orchestra.run.smithi184.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.5 MB/s | 358 kB 00:00 2024-09-19T08:50:46.186 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-19T08:50:46.208 INFO:teuthology.orchestra.run.smithi184.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T08:50:46.234 INFO:teuthology.orchestra.run.smithi184.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:50:46.305 INFO:teuthology.orchestra.run.smithi184.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-19T08:50:46.326 INFO:teuthology.orchestra.run.smithi184.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-19T08:50:46.338 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-19T08:50:46.338 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-19T08:50:46.351 INFO:teuthology.orchestra.run.smithi184.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T08:50:46.377 INFO:teuthology.orchestra.run.smithi184.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-19T08:50:46.402 INFO:teuthology.orchestra.run.smithi184.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T08:50:46.427 INFO:teuthology.orchestra.run.smithi184.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T08:50:46.452 INFO:teuthology.orchestra.run.smithi184.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T08:50:46.478 INFO:teuthology.orchestra.run.smithi184.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:50:46.495 INFO:teuthology.orchestra.run.smithi184.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-19T08:50:46.520 INFO:teuthology.orchestra.run.smithi184.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:50:46.562 INFO:teuthology.orchestra.run.smithi184.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-19T08:50:46.596 INFO:teuthology.orchestra.run.smithi184.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi184.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T08:50:46.646 INFO:teuthology.orchestra.run.smithi184.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:50:46.671 INFO:teuthology.orchestra.run.smithi184.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T08:50:46.697 INFO:teuthology.orchestra.run.smithi184.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T08:50:46.722 INFO:teuthology.orchestra.run.smithi184.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T08:50:46.747 INFO:teuthology.orchestra.run.smithi184.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T08:50:46.773 INFO:teuthology.orchestra.run.smithi184.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T08:50:46.798 INFO:teuthology.orchestra.run.smithi184.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T08:50:46.840 INFO:teuthology.orchestra.run.smithi184.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-19T08:50:46.865 INFO:teuthology.orchestra.run.smithi184.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-19T08:50:46.890 INFO:teuthology.orchestra.run.smithi184.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T08:50:46.916 INFO:teuthology.orchestra.run.smithi184.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T08:50:46.941 INFO:teuthology.orchestra.run.smithi184.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:50:46.975 INFO:teuthology.orchestra.run.smithi184.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T08:50:47.025 INFO:teuthology.orchestra.run.smithi184.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:50:47.217 INFO:teuthology.orchestra.run.smithi184.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T08:50:47.259 INFO:teuthology.orchestra.run.smithi184.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 9.9 MB/s | 2.3 MB 00:00 2024-09-19T08:50:47.326 INFO:teuthology.orchestra.run.smithi184.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-19T08:50:47.351 INFO:teuthology.orchestra.run.smithi184.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 446 kB/s | 41 kB 00:00 2024-09-19T08:50:47.418 INFO:teuthology.orchestra.run.smithi184.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 9.0 MB/s | 1.8 MB 00:00 2024-09-19T08:50:47.443 INFO:teuthology.orchestra.run.smithi184.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-19T08:50:47.476 INFO:teuthology.orchestra.run.smithi184.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-19T08:50:47.519 INFO:teuthology.orchestra.run.smithi184.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-19T08:50:47.524 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:47.525 INFO:teuthology.orchestra.run.smithi184.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-19T08:50:48.594 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-19T08:50:48.594 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-19T08:50:48.716 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-19T08:50:48.869 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-19T08:50:48.869 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-19T08:50:49.180 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-19T08:50:49.281 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:50:49.319 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:50:49.373 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:50:49.405 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:50:49.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:50:49.481 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:50:49.829 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:50:49.971 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:50:50.305 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:50:50.333 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:50:50.425 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:50:50.460 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:50:50.650 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:50:50.711 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:50:50.738 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:50:50.842 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:50:50.864 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:50:50.928 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:50:50.957 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:50:50.978 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:50:51.165 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-19T08:50:51.165 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-19T08:50:51.200 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:50:51.388 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:50:51.506 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:50:51.621 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:51.690 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:51.921 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:52.034 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:50:52.125 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:50:52.169 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:50:52.214 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:50:52.279 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:50:52.323 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:50:52.372 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:50:52.416 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:50:52.448 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:50:52.476 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:50:52.546 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:50:52.597 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:50:52.629 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:50:52.690 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:50:52.757 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:50:52.800 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:50:52.849 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:50:52.880 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:50:52.949 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:50:52.995 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:50:53.069 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:50:53.201 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:50:53.264 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:50:53.785 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:50:53.886 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:50:53.923 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:50:53.966 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:50:54.004 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:50:54.054 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:50:54.230 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:50:54.290 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:50:54.345 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:50:54.420 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:50:54.458 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:50:54.549 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:50:54.586 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:50:54.628 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:50:54.671 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:50:54.809 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:50:54.848 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:50:54.857 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-19T08:50:54.889 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:50:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:50:54.999 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:50:55.036 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:50:55.040 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:50:55.094 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:50:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:50:55.127 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:50:55.130 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:50:55.154 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:50:55.155 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:50:55.203 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:50:55.266 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:50:55.394 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:50:55.433 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:50:55.472 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:50:55.512 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:50:55.533 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:50:55.554 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:50:55.582 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:50:55.735 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:50:55.768 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:50:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:50:55.805 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:50:55.847 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:50:55.890 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:50:55.943 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:50:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:50:55.984 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:50:56.037 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:50:56.069 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:50:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:50:56.111 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:50:56.171 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:50:56.219 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:50:56.279 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:50:56.332 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:50:56.360 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:50:56.463 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:50:56.486 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:50:56.549 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:50:56.574 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:50:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:50:56.789 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:50:56.937 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:50:57.019 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:50:57.092 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:50:57.136 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:50:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:50:57.246 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:50:57.262 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:50:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:57.344 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:50:57.381 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-19T08:50:57.433 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:50:57.464 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:50:57.489 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:50:57.527 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:50:57.560 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:57.597 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:50:57.630 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:50:57.650 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:50:57.665 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:50:57.689 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:50:57.695 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:50:57.716 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:50:57.774 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:50:57.781 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:50:57.826 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:50:57.869 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:50:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:50:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:50:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:50:58.047 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:50:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:50:58.095 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:50:58.122 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:50:58.158 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:50:58.194 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:50:58.253 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:50:58.280 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:50:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:50:58.308 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:50:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:50:58.405 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:50:58.408 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:50:58.438 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:50:58.447 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:50:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:50:58.491 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:50:58.518 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:50:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:50:58.588 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:50:58.600 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:50:58.642 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:50:58.651 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:50:58.696 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:50:58.717 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:50:58.782 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:50:58.805 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:50:58.857 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:50:58.868 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:50:58.890 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:50:58.911 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:50:58.916 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:50:59.083 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:50:59.253 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:50:59.371 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:50:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:50:59.495 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:50:59.552 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:50:59.556 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:59.604 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:50:59.641 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:50:59.684 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:50:59.794 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:50:59.835 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:50:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:50:59.895 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:50:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:50:59.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:50:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:50:59.948 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:50:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:51:00.022 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:51:00.025 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:51:00.062 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:51:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:51:00.098 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:51:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:51:00.145 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:51:00.179 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:51:00.181 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:51:00.222 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:51:00.224 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:51:00.263 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:51:00.266 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:51:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:51:00.306 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:51:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:51:00.338 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:51:00.366 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:51:00.401 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:51:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:51:00.436 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:51:00.451 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:51:00.456 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:51:00.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:51:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:51:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:51:00.519 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:51:00.563 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:51:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:51:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:51:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:51:00.680 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:51:00.690 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:51:00.721 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:51:00.733 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:51:00.745 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:51:00.762 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:51:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:51:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:51:00.885 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:51:00.960 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:51:00.962 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:51:00.973 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:51:01.003 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:51:01.004 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:51:01.030 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:51:01.065 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:51:01.076 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:51:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:51:01.104 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:51:01.114 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:51:01.135 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:51:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:51:01.165 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:51:01.200 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:51:01.234 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:51:01.334 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:51:01.401 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:51:01.488 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:51:01.562 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:51:01.672 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:51:01.696 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:51:01.747 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:51:01.758 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:51:01.787 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:51:01.839 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:51:01.876 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:51:01.918 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:51:02.082 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:51:02.154 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:51:02.209 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:51:02.281 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:51:02.313 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:51:02.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:51:02.397 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:51:02.440 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:51:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:51:02.484 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:51:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:51:02.526 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:51:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:51:02.644 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:51:02.664 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:51:02.701 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:51:02.702 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:51:02.744 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:51:02.746 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:51:02.832 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:51:02.847 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:51:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:51:02.878 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:51:02.918 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:51:02.951 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:51:02.976 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:51:03.059 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:51:03.097 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:51:03.177 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:51:03.213 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:51:03.385 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:51:03.424 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:51:03.453 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:51:03.487 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:51:03.526 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:51:03.557 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:51:03.590 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:51:03.616 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:51:03.641 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:51:03.677 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:51:03.726 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:51:03.812 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:51:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:51:03.856 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:51:03.887 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:51:03.944 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:51:03.991 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:51:04.055 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:51:04.227 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:04.273 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:51:04.365 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:51:04.365 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:51:04.365 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:51:04.365 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:04.408 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:51:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:51:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:51:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:51:04.953 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:51:05.007 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:51:05.052 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:51:05.141 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:51:05.180 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:51:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:51:05.328 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:51:05.362 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:51:05.364 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:51:05.394 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:51:05.472 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:51:05.500 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:51:05.976 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:51:06.018 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:51:06.109 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:51:06.124 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:51:06.140 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:51:06.176 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:51:06.242 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:51:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:51:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:51:06.760 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:51:06.790 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:51:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:51:07.583 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:51:07.611 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:51:07.644 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:51:07.955 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:51:08.015 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:51:08.106 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:51:08.137 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:51:08.181 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:51:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:51:08.843 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:51:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:51:08.970 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:51:09.098 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:09.136 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:09.744 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:51:09.839 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:51:09.839 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:51:09.839 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:51:09.839 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:09.883 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:51:11.328 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:11.366 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:11.924 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:51:11.961 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:51:12.051 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:51:12.051 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:51:12.051 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:51:12.051 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /root 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-09-19T08:51:16.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:16.421 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:51:16.438 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:51:16.438 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:16.438 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:51:16.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:17.899 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:51:17.926 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:51:17.926 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:17.926 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:51:17.926 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:51:17.926 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:51:17.926 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:18.158 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:51:18.181 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:51:18.181 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:18.181 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:51:18.181 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:51:18.182 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:51:18.182 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:18.625 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:51:18.649 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:51:18.649 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:18.649 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:51:18.649 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:51:18.649 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:51:18.649 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:18.747 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:51:18.812 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:51:18.868 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:51:19.052 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:51:19.101 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:51:19.172 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:51:19.285 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:51:19.422 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:51:19.479 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:51:19.517 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:51:19.545 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:51:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:51:19.952 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:51:19.983 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:51:20.046 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:51:20.075 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:51:21.137 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:51:21.168 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:51:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-09-19T08:51:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:22.039 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:51:22.054 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:51:22.054 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:22.054 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:51:22.055 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:22.139 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:51:22.172 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:51:22.275 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:51:22.432 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:51:22.471 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:51:22.496 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:51:22.496 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:22.496 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:51:22.496 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:51:22.496 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:51:22.496 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:22.555 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:51:22.567 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:51:22.665 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:51:22.733 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:51:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:51:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:51:23.592 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:23.592 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:51:23.592 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:51:23.592 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:51:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:51:23.611 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-09-19T08:51:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:23.652 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:51:23.683 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:51:23.707 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:51:23.707 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:23.707 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:51:23.707 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:51:23.707 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:51:23.707 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:23.750 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:51:23.773 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:51:23.773 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:23.774 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:51:23.774 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:23.780 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:51:23.796 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:51:23.796 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:23.796 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:51:23.796 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:23.815 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:51:23.817 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:51:23.839 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:51:23.839 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:23.839 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:51:23.839 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:51:23.839 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:51:23.839 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:23.841 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:51:23.841 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:23.841 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:51:23.841 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:51:23.841 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:51:23.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:24.143 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:51:24.167 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:51:24.167 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:24.167 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:51:24.167 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:24.168 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:24.168 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:24.283 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:51:24.306 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:51:24.306 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:24.307 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:51:24.307 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:51:24.307 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:51:24.307 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:51:24.460 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:51:24.515 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:51:24.707 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:51:24.758 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:51:24.827 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:51:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:51:25.053 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:51:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:51:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:51:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:51:25.301 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:51:25.328 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:51:25.328 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:25.328 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:51:25.328 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:51:25.328 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:51:25.328 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:25.569 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:51:25.593 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:51:25.593 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:25.593 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:51:25.593 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:51:25.593 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:51:25.593 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:25.639 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:51:25.667 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:51:25.699 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:51:25.761 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:51:25.791 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:51:26.028 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:51:26.051 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:51:26.051 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:26.052 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:51:26.052 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:51:26.052 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:51:26.052 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:26.158 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:51:26.208 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:51:26.263 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:51:26.449 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:51:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:51:26.582 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:51:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:51:26.820 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:51:26.826 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:51:26.859 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:51:26.903 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:51:26.936 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:51:26.972 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:51:27.392 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:51:27.420 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:51:27.451 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:51:27.514 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:51:27.543 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:51:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:51:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:51:27.945 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:51:28.112 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:51:28.145 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:51:28.169 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:51:28.169 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:28.169 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:51:28.169 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:51:28.170 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:51:28.170 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:28.221 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:51:28.232 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:51:28.341 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:51:28.400 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:51:28.593 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:51:28.628 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:51:28.739 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:51:28.789 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:51:28.837 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:51:28.870 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:51:28.897 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:51:29.086 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:51:29.136 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:51:29.166 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:51:29.204 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:51:29.250 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:51:29.333 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:51:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:51:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:51:29.389 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:29.389 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:51:29.389 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:51:29.389 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:51:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:51:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:51:29.455 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:29.455 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:51:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:29.508 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:51:29.532 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:51:29.532 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:29.532 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:51:29.532 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:51:29.532 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:51:29.532 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:51:29.724 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:51:29.842 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:51:29.865 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:51:29.865 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:29.866 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:51:29.866 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:29.866 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:29.866 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:29.877 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:29.891 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:51:29.913 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:51:29.915 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:29.937 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:29.938 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:51:29.938 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:29.938 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:51:29.938 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:51:29.938 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:51:29.938 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:29.989 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:51:30.001 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:51:30.098 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:51:30.151 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:51:30.779 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:51:30.912 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:51:30.959 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:51:31.051 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:51:31.071 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:51:31.082 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:51:31.100 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:51:31.108 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:51:31.124 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:51:31.125 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:31.125 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:51:31.125 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:51:31.125 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:51:31.125 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:31.150 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:51:31.150 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:51:31.167 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:51:31.191 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:51:31.191 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:31.191 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:51:31.191 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:31.234 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:51:31.234 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:51:31.235 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:51:31.258 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:51:31.259 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:31.259 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:51:31.259 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:51:31.259 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:51:31.259 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:31.310 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:51:31.335 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:51:31.341 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:31.341 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:31.520 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:31.520 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:51:31.561 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:51:31.584 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:51:31.584 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:31.584 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:51:31.584 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:31.585 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:31.585 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:31.604 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:51:31.670 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:34.438 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:51:34.479 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:51:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:51:34.552 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:51:34.579 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:51:34.780 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:51:34.826 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:51:34.856 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:51:34.886 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:51:34.932 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:51:35.536 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:35.572 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:35.594 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:51:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:51:36.237 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:51:36.269 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:51:36.298 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:51:36.422 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:51:36.485 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:51:36.535 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:51:36.536 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:51:36.565 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:51:36.581 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:51:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:51:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:51:36.677 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:51:36.713 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:51:36.748 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:51:36.773 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:51:36.774 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:51:36.866 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:51:36.866 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:51:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:51:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:51:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:51:37.223 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:37.252 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:51:37.255 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:37.275 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:51:37.325 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:51:37.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:51:37.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:51:37.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:51:37.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:51:37.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:51:37.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:51:37.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:51:37.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:51:37.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:51:37.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:51:37.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:51:37.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:51:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:51:37.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:51:37.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:51:37.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:51:37.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:51:37.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:51:38.104 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:51:38.193 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:51:38.238 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:51:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:51:38.354 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:51:38.380 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:51:38.406 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:51:38.406 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:51:38.490 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:51:38.490 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:51:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:51:38.599 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:51:38.604 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:38.604 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:51:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:51:38.877 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:51:38.942 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:40.497 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.498 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:51:40.500 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:51:40.501 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:51:40.502 INFO:teuthology.orchestra.run.smithi083.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:51:40.503 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:51:40.504 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:51:40.505 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:51:40.506 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:51:40.507 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:51:40.508 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:51:40.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:51:40.510 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-19T08:51:40.901 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:51:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:51:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:51:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:51:43.362 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:51:43.362 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:51:43.363 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:51:43.364 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:51:43.365 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:51:43.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:51:43.367 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:51:43.368 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:51:43.369 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:51:43.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:51:43.371 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:51:43.372 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:51:43.373 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:51:43.374 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:51:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:51:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:51:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:51:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:51:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:51:44.451 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:51:44.452 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:51:44.464 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:51:44.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:51:44.466 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:51:44.467 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:51:44.468 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:51:44.469 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:51:44.470 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:51:44.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:51:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:51:44.473 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:51:44.474 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:51:44.475 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:51:44.475 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:51:44.475 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:51:46.226 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-19T08:51:46.227 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.228 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.229 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:51:46.230 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:51:46.231 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:51:46.232 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:51:46.233 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:51:46.234 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:51:46.235 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:51:46.236 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:46.237 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:51:46.238 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-19T08:51:46.640 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:47.275 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.276 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.277 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:51:47.278 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:51:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:51:47.280 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:51:47.281 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:51:47.282 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:51:47.283 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:51:47.284 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:51:47.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:51:47.286 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:51:47.287 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:51:47.288 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:51:47.288 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:51:47.288 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-19T08:51:47.672 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:47.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:47.816 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:51:47.842 INFO:teuthology.orchestra.run.smithi083.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:51:47.842 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:51:47.843 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:51:47.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:47.979 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:51:48.005 INFO:teuthology.orchestra.run.smithi122.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:51:48.005 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:51:48.006 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:51:48.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:48.142 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:51:48.165 INFO:teuthology.orchestra.run.smithi184.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:51:48.165 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:51:48.165 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:51:48.167 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:51:48.168 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:51:48.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:51:48.200 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:51:48.200 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:51:48.233 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:51:48.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:51:48.261 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:51:48.261 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:51:48.261 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:51:48.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:51:48.359 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:51:48.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:51:48.389 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:51:48.458 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:51:48.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:51:48.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:51:48.550 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:51:48.551 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:51:48.551 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:51:48.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:51:48.647 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:51:48.647 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:51:48.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:51:48.746 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:51:48.746 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:51:48.771 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:51:48.836 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:51:48.836 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:51:48.836 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:51:48.865 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:51:48.933 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:51:48.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:51:48.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:51:49.031 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:51:49.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:51:49.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:51:49.121 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:51:49.222 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T08:51:49.223 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:49.223 INFO:tasks.cephadm:Cluster fsid is 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:51:49.223 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:51:49.223 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.83', 'mon.b': '172.21.15.122', 'mon.c': '172.21.15.184'} 2024-09-19T08:51:49.224 INFO:tasks.cephadm:First mon is mon.a on smithi083 2024-09-19T08:51:49.224 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:51:49.224 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:51:49.224 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname $(hostname -s) 2024-09-19T08:51:49.254 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2024-09-19T08:51:49.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2024-09-19T08:51:49.308 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:51:49.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:49.458 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:51:49.597 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:49.598 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:51:49.598 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:51:49.598 DEBUG:teuthology.orchestra.run.smithi083:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:50.235 INFO:teuthology.orchestra.run.smithi083.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:51 /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:50.235 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:51.065 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:51 /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:51.065 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:52.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:51 /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:52.140 DEBUG:teuthology.orchestra.run.smithi083:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:52.159 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:52.179 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:52.213 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:51:52.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:51:52.215 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:51:52.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:51:53.850 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:51:53.876 INFO:teuthology.orchestra.run.smithi083.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:51:53.883 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:52:23.738 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-19T08:52:23.739 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:52:23.739 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:52:23.739 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2024-09-19T08:52:23.739 INFO:teuthology.orchestra.run.smithi184.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:52:23.739 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-19T08:52:23.739 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-19T08:52:40.924 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-19T08:52:40.925 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:52:40.925 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:52:40.925 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2024-09-19T08:52:40.925 INFO:teuthology.orchestra.run.smithi122.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:52:40.925 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-19T08:52:40.925 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout: "repo_digests": [ 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T08:52:41.035 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T08:52:41.061 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph 2024-09-19T08:52:41.107 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2024-09-19T08:52:41.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2024-09-19T08:52:41.171 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /etc/ceph 2024-09-19T08:52:41.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2024-09-19T08:52:41.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2024-09-19T08:52:41.250 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:52:41.251 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:52:41.251 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:52:41.252 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:52:41.253 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:52:41.254 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:52:41.255 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:52:41.255 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-19T08:52:41.255 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:52:41.255 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:52:41.255 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:52:41.255 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T08:52:41.256 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:52:41.256 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:52:41.271 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 68681c4c-7664-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:52:41.271 DEBUG:teuthology.orchestra.run.smithi083:mon.a> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:52:41.314 DEBUG:teuthology.orchestra.run.smithi083:mgr.x> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:52:41.357 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:52:41.357 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.83 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:52:41.559 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:52:41.559 INFO:teuthology.orchestra.run.smithi083.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '68681c4c-7664-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.83', '--skip-admin-label'] 2024-09-19T08:52:41.559 INFO:teuthology.orchestra.run.smithi083.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:52:41.560 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying podman|docker is present... 2024-09-19T08:52:41.583 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:52:41.583 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying lvm2 is present... 2024-09-19T08:52:41.583 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying time synchronization is in place... 2024-09-19T08:52:41.591 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:52:41.591 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:52:41.597 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:52:41.597 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-19T08:52:41.604 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout enabled 2024-09-19T08:52:41.610 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout active 2024-09-19T08:52:41.610 INFO:teuthology.orchestra.run.smithi083.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:52:41.610 INFO:teuthology.orchestra.run.smithi083.stdout:Repeating the final host check... 2024-09-19T08:52:41.632 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:52:41.632 INFO:teuthology.orchestra.run.smithi083.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:52:41.632 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl is present 2024-09-19T08:52:41.632 INFO:teuthology.orchestra.run.smithi083.stdout:lvcreate is present 2024-09-19T08:52:41.639 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:52:41.639 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:52:41.645 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:52:41.645 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-19T08:52:41.652 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout enabled 2024-09-19T08:52:41.658 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout active 2024-09-19T08:52:41.658 INFO:teuthology.orchestra.run.smithi083.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:52:41.658 INFO:teuthology.orchestra.run.smithi083.stdout:Host looks OK 2024-09-19T08:52:41.658 INFO:teuthology.orchestra.run.smithi083.stdout:Cluster fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:41.658 INFO:teuthology.orchestra.run.smithi083.stdout:Acquiring lock 140513419240448 on /run/cephadm/68681c4c-7664-11ef-bceb-c7b262605968.lock 2024-09-19T08:52:41.658 INFO:teuthology.orchestra.run.smithi083.stdout:Lock 140513419240448 acquired on /run/cephadm/68681c4c-7664-11ef-bceb-c7b262605968.lock 2024-09-19T08:52:41.659 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying IP 172.21.15.83 port 3300 ... 2024-09-19T08:52:41.659 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying IP 172.21.15.83 port 6789 ... 2024-09-19T08:52:41.659 INFO:teuthology.orchestra.run.smithi083.stdout:Base mon IP(s) is [172.21.15.83:3300, 172.21.15.83:6789], mon addrv is [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-09-19T08:52:41.662 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.83 metric 100 2024-09-19T08:52:41.663 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.83 metric 100 2024-09-19T08:52:41.665 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:52:41.665 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T08:52:41.665 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T08:52:41.668 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:52:41.668 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:52:41.668 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:52:41.668 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T08:52:41.668 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-19T08:52:41.668 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:52:41.669 INFO:teuthology.orchestra.run.smithi083.stdout:Mon IP `172.21.15.83` is in CIDR network `172.21.0.0/20` 2024-09-19T08:52:41.669 INFO:teuthology.orchestra.run.smithi083.stdout:Mon IP `172.21.15.83` is in CIDR network `172.21.0.0/20` 2024-09-19T08:52:41.669 INFO:teuthology.orchestra.run.smithi083.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:52:41.669 INFO:teuthology.orchestra.run.smithi083.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:52:41.670 INFO:teuthology.orchestra.run.smithi083.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:52:42.196 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi083.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi083.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:52:43.017 INFO:teuthology.orchestra.run.smithi083.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:52:43.889 INFO:teuthology.orchestra.run.smithi083.stdout:stat: stdout 167 167 2024-09-19T08:52:43.889 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial keys... 2024-09-19T08:52:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQBc5utmTZdRDBAAfif9L5SUDmDz8gL6/R2ZPA== 2024-09-19T08:52:45.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQBd5utmQUa6DxAAYKjnbXlsITUCTnMUhc+CVA== 2024-09-19T08:52:46.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQBe5utmMQSMCRAA4XxQda5va0W6iA/CEsdVlA== 2024-09-19T08:52:46.765 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial monmap... 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool for a [v2:172.21.15.83:3300,v1:172.21.15.83:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = quincy 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: set fsid to 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:52:47.705 INFO:teuthology.orchestra.run.smithi083.stdout:Creating mon... 2024-09-19T08:52:48.693 INFO:teuthology.orchestra.run.smithi083.stdout:create mon.a on 2024-09-19T08:52:48.909 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:52:49.049 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:52:49.236 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-68681c4c-7664-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-68681c4c-7664-11ef-bceb-c7b262605968.target. 2024-09-19T08:52:49.237 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-68681c4c-7664-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-68681c4c-7664-11ef-bceb-c7b262605968.target. 2024-09-19T08:52:49.484 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:52:49.484 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to reset failed state of unit ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:52:49.651 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-68681c4c-7664-11ef-bceb-c7b262605968.target.wants/ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-68681c4c-7664-11ef-bceb-c7b262605968@.service. 2024-09-19T08:52:50.195 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:52:50.195 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-19T08:52:50.203 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:52:50.203 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-19T08:52:50.203 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-19T08:52:50.203 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:52:50.204 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mon to start... 2024-09-19T08:52:50.204 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mon... 2024-09-19T08:52:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:50 smithi083 systemd[1]: Started Ceph mon.a for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout id: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.624104s) 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:52:51.295 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.667+0000 7f4c154b0640 1 Processor -- start 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c154b0640 1 -- start start 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c154b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c154b0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10075940 con 0x7f4c10108080 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40010/0 (socket says 172.21.15.83:40010) 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c0effd640 1 -- 172.21.15.83:0/3311709296 learned_addr learned my addr 172.21.15.83:0/3311709296 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.668+0000 7f4c0effd640 1 -- 172.21.15.83:0/3311709296 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1010a9b0 con 0x7f4c10108080 2024-09-19T08:52:51.296 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.670+0000 7f4c0effd640 1 --2- 172.21.15.83:0/3311709296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1010a470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009820 tx=0x7f4bf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b227076b782275b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c0dffb640 1 -- 172.21.15.83:0/3311709296 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8037070 con 0x7f4c10108080 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c0dffb640 1 -- 172.21.15.83:0/3311709296 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8032440 con 0x7f4c10108080 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c0dffb640 1 -- 172.21.15.83:0/3311709296 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8032740 con 0x7f4c10108080 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 -- 172.21.15.83:0/3311709296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 msgr2=0x7f4c1010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 --2- 172.21.15.83:0/3311709296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1010a470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009820 tx=0x7f4bf802a270 comp rx=0 tx=0).stop 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 -- 172.21.15.83:0/3311709296 shutdown_connections 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 --2- 172.21.15.83:0/3311709296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1010a470 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 -- 172.21.15.83:0/3311709296 >> 172.21.15.83:0/3311709296 conn(0x7f4c10101cc0 msgr2=0x7f4c101040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 -- 172.21.15.83:0/3311709296 shutdown_connections 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.671+0000 7f4c154b0640 1 -- 172.21.15.83:0/3311709296 wait complete. 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c154b0640 1 Processor -- start 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c154b0640 1 -- start start 2024-09-19T08:52:51.297 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c154b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c154b0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1010ae90 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1019ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40012/0 (socket says 172.21.15.83:40012) 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.672+0000 7f4c0effd640 1 -- 172.21.15.83:0/1187779214 learned_addr learned my addr 172.21.15.83:0/1187779214 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c0effd640 1 -- 172.21.15.83:0/1187779214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1019b2e0 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c0effd640 1 --2- 172.21.15.83:0/1187779214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1019ada0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80090b0 tx=0x7f4bf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8041070 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf803c7a0 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1019b570 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8037040 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1019e220 con 0x7f4c10108080 2024-09-19T08:52:51.298 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4bf8044070 con 0x7f4c10108080 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.673+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4bf803d3f0 con 0x7f4c10108080 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.674+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c101084e0 con 0x7f4c10108080 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.676+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4bf8046450 con 0x7f4c10108080 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.735+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f4c1002d9b0 con 0x7f4c10108080 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.735+0000 7f4c07fff640 1 -- 172.21.15.83:0/1187779214 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f4bf8046630 con 0x7f4c10108080 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 msgr2=0x7f4c1019ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 --2- 172.21.15.83:0/1187779214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1019ada0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80090b0 tx=0x7f4bf80046c0 comp rx=0 tx=0).stop 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 shutdown_connections 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 --2- 172.21.15.83:0/1187779214 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c10108080 0x7f4c1019ada0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 >> 172.21.15.83:0/1187779214 conn(0x7f4c10101cc0 msgr2=0x7f4c10102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 shutdown_connections 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:50.736+0000 7f4c154b0640 1 -- 172.21.15.83:0/1187779214 wait complete. 2024-09-19T08:52:51.299 INFO:teuthology.orchestra.run.smithi083.stdout:mon is available 2024-09-19T08:52:51.300 INFO:teuthology.orchestra.run.smithi083.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:52:51.412 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:52:51.412 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: monmap epoch 1 2024-09-19T08:52:51.412 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:51.412 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: last_changed 2024-09-19T08:52:47.071352+0000 2024-09-19T08:52:51.412 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:52:51.412 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: min_mon_release 19 (squid) 2024-09-19T08:52:51.413 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: election_strategy: 1 2024-09-19T08:52:51.413 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:52:51.413 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: fsmap 2024-09-19T08:52:51.413 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:52:51.413 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: mgrmap e1: no daemons active 2024-09-19T08:52:51.413 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:51 smithi083 ceph-mon[30558]: from='client.? 172.21.15.83:0/1187779214' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T08:52:52.418 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:52 smithi083 ceph-mon[30558]: from='client.? 172.21.15.83:0/1980174799' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:52:52.418 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:52 smithi083 ceph-mon[30558]: from='client.? 172.21.15.83:0/1980174799' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout fsid = 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd98e9640 1 Processor -- start 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd98e9640 1 -- start start 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd98e9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd41079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd98e9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4107fb0 con 0x7f2fd41075e0 2024-09-19T08:52:52.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd41079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd41079e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40024/0 (socket says 172.21.15.83:40024) 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd2ffd640 1 -- 172.21.15.83:0/2548751344 learned_addr learned my addr 172.21.15.83:0/2548751344 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.699+0000 7f2fd2ffd640 1 -- 172.21.15.83:0/2548751344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd4108790 con 0x7f2fd41075e0 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.700+0000 7f2fd2ffd640 1 --2- 172.21.15.83:0/2548751344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd41079e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009820 tx=0x7f2fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb6285b2350f9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.700+0000 7f2fd1ffb640 1 -- 172.21.15.83:0/2548751344 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4037070 con 0x7f2fd41075e0 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.700+0000 7f2fd1ffb640 1 -- 172.21.15.83:0/2548751344 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc4032440 con 0x7f2fd41075e0 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.700+0000 7f2fd1ffb640 1 -- 172.21.15.83:0/2548751344 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4032740 con 0x7f2fd41075e0 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 -- 172.21.15.83:0/2548751344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 msgr2=0x7f2fd41079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 --2- 172.21.15.83:0/2548751344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd41079e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009820 tx=0x7f2fc402a270 comp rx=0 tx=0).stop 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 -- 172.21.15.83:0/2548751344 shutdown_connections 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 --2- 172.21.15.83:0/2548751344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd41079e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 -- 172.21.15.83:0/2548751344 >> 172.21.15.83:0/2548751344 conn(0x7f2fd4102db0 msgr2=0x7f2fd41051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 -- 172.21.15.83:0/2548751344 shutdown_connections 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.701+0000 7f2fd98e9640 1 -- 172.21.15.83:0/2548751344 wait complete. 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd98e9640 1 Processor -- start 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd98e9640 1 -- start start 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd98e9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd98e9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4108d30 con 0x7f2fd41075e0 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd419ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40034/0 (socket says 172.21.15.83:40034) 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd2ffd640 1 -- 172.21.15.83:0/1980174799 learned_addr learned my addr 172.21.15.83:0/1980174799 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd2ffd640 1 -- 172.21.15.83:0/1980174799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd419b2e0 con 0x7f2fd41075e0 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.702+0000 7f2fd2ffd640 1 --2- 172.21.15.83:0/1980174799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd419ada0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40090b0 tx=0x7f2fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4041070 con 0x7f2fd41075e0 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc403c7a0 con 0x7f2fd41075e0 2024-09-19T08:52:52.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc4037040 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd419b570 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd419e220 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2fc4044070 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.703+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2fc403d3f0 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.704+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd4109380 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.706+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2fc4046450 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.762+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2fd419f980 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.765+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+454 (secure 0 0 0) 0x7f2fc4046630 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.766+0000 7f2fd88e7640 1 -- 172.21.15.83:0/1980174799 <== mon.0 v2:172.21.15.83:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2fc4056070 con 0x7f2fd41075e0 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 msgr2=0x7f2fd419ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 --2- 172.21.15.83:0/1980174799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd419ada0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40090b0 tx=0x7f2fc40046c0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.431 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 shutdown_connections 2024-09-19T08:52:52.432 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 --2- 172.21.15.83:0/1980174799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fd41075e0 0x7f2fd419ada0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.432 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 >> 172.21.15.83:0/1980174799 conn(0x7f2fd4102db0 msgr2=0x7f2fd418ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.432 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 shutdown_connections 2024-09-19T08:52:52.432 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:51.767+0000 7f2fd98e9640 1 -- 172.21.15.83:0/1980174799 wait complete. 2024-09-19T08:52:52.432 INFO:teuthology.orchestra.run.smithi083.stdout:Generating new minimal ceph.conf... 2024-09-19T08:52:53.450 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:53 smithi083 ceph-mon[30558]: from='client.? 172.21.15.83:0/1551275521' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd399d55640 1 Processor -- start 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd399d55640 1 -- start start 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd399d55640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd399d55640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd394075920 con 0x7fd394108080 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd3937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd3937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40048/0 (socket says 172.21.15.83:40048) 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.821+0000 7fd3937fe640 1 -- 172.21.15.83:0/282389148 learned_addr learned my addr 172.21.15.83:0/282389148 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.822+0000 7fd3937fe640 1 -- 172.21.15.83:0/282389148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39410a9b0 con 0x7fd394108080 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.822+0000 7fd3937fe640 1 --2- 172.21.15.83:0/282389148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39410a470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009e80 tx=0x7fd38c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774e255ff9b8b05f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:53.457 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.822+0000 7fd3927fc640 1 -- 172.21.15.83:0/282389148 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c036070 con 0x7fd394108080 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd3927fc640 1 -- 172.21.15.83:0/282389148 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd38c031890 con 0x7fd394108080 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd3927fc640 1 -- 172.21.15.83:0/282389148 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c007980 con 0x7fd394108080 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 -- 172.21.15.83:0/282389148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 msgr2=0x7fd39410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 --2- 172.21.15.83:0/282389148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39410a470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009e80 tx=0x7fd38c02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 -- 172.21.15.83:0/282389148 shutdown_connections 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 --2- 172.21.15.83:0/282389148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39410a470 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 -- 172.21.15.83:0/282389148 >> 172.21.15.83:0/282389148 conn(0x7fd394101cc0 msgr2=0x7fd3941040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 -- 172.21.15.83:0/282389148 shutdown_connections 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.823+0000 7fd399d55640 1 -- 172.21.15.83:0/282389148 wait complete. 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd399d55640 1 Processor -- start 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd399d55640 1 -- start start 2024-09-19T08:52:53.458 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd399d55640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd399d55640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd39410b990 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd3937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd3937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40054/0 (socket says 172.21.15.83:40054) 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.824+0000 7fd3937fe640 1 -- 172.21.15.83:0/1551275521 learned_addr learned my addr 172.21.15.83:0/1551275521 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd3937fe640 1 -- 172.21.15.83:0/1551275521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39419ba80 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd3937fe640 1 --2- 172.21.15.83:0/1551275521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39419b540 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009680 tx=0x7fd38c031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c041020 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39419bd10 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd38c03c900 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c036040 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39419ea00 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd38c044020 con 0x7fd394108080 2024-09-19T08:52:53.459 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.825+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd38c046d80 con 0x7fd394108080 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.826+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3941084e0 con 0x7fd394108080 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.828+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd38c04b020 con 0x7fd394108080 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.885+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd39419ef80 con 0x7fd394108080 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.885+0000 7fd390ff9640 1 -- 172.21.15.83:0/1551275521 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fd38c03cab0 con 0x7fd394108080 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 msgr2=0x7fd39419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 --2- 172.21.15.83:0/1551275521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39419b540 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009680 tx=0x7fd38c031c70 comp rx=0 tx=0).stop 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 shutdown_connections 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 --2- 172.21.15.83:0/1551275521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd394108080 0x7fd39419b540 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 >> 172.21.15.83:0/1551275521 conn(0x7fd394101cc0 msgr2=0x7fd394102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 shutdown_connections 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:52.886+0000 7fd399d55640 1 -- 172.21.15.83:0/1551275521 wait complete. 2024-09-19T08:52:53.460 INFO:teuthology.orchestra.run.smithi083.stdout:Restarting the monitor... 2024-09-19T08:52:53.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:53 smithi083 systemd[1]: Stopping Ceph mon.a for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T08:52:54.088 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:53 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a[30554]: 2024-09-19T08:52:53.737+0000 7fa3dfefd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:52:54.088 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:53 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a[30554]: 2024-09-19T08:52:53.737+0000 7fa3dfefd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:52:54.088 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:53 smithi083 podman[30801]: 2024-09-19 08:52:53.850956467 +0000 UTC m=+0.238338970 container died 212568b339dc83d6df27d04e088aa8df88c75d31550d75a4559b3dd39582496d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:52:54.379 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 podman[30801]: 2024-09-19 08:52:54.187701827 +0000 UTC m=+0.575084318 container cleanup 212568b339dc83d6df27d04e088aa8df88c75d31550d75a4559b3dd39582496d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T08:52:54.379 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 bash[30801]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:52:54.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 podman[30815]: 2024-09-19 08:52:54.380245354 +0000 UTC m=+0.526832001 container remove 212568b339dc83d6df27d04e088aa8df88c75d31550d75a4559b3dd39582496d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:52:54.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:52:54.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 systemd[1]: Stopped Ceph mon.a for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:52:54.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 systemd[1]: Starting Ceph mon.a for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T08:52:55.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 podman[30906]: 2024-09-19 08:52:54.706651008 +0000 UTC m=+0.015732797 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:52:55.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:54 smithi083 podman[30906]: 2024-09-19 08:52:54.822717101 +0000 UTC m=+0.131798925 container create 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:52:55.058 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 podman[30906]: 2024-09-19 08:52:55.058426037 +0000 UTC m=+0.367507826 container init 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T08:52:55.128 INFO:teuthology.orchestra.run.smithi083.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 podman[30906]: 2024-09-19 08:52:55.061525721 +0000 UTC m=+0.370607502 container start 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: pidfile_write: ignore empty --pid-file 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: load: jerasure load: lrc 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:52:55.333 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Git sha 0 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: DB SUMMARY 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: DB Session ID: 6FFZ07M4FU5ZK7YAD2MT 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105144 ; 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:52:55.334 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.env: 0x564f2b249940 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.info_log: 0x564f2bb7b6e0 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.statistics: (nil) 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.use_fsync: 0 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:52:55.335 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.db_log_dir: 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.wal_dir: 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:52:55.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.write_buffer_manager: 0x564f2bb8adc0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.unordered_write: 0 2024-09-19T08:52:55.337 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.row_cache: None 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.wal_filter: None 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:52:55.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.wal_compression: 0 2024-09-19T08:52:55.339 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:52:55.339 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:52:55.339 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:52:55.339 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:52:55.340 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:52:55.340 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:52:55.341 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_open_files: -1 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:52:55.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Compression algorithms supported: 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kZSTD supported: 0 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:52:55.343 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.merge_operator: 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_filter: None 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564f2bb7b320) 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:52:55.344 INFO:journalctl@ceph.mon.a.smithi083.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_type: 0 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: data_block_index_type: 0 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_shortening: 1 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: checksum: 4 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: no_block_cache: 0 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache: 0x564f2bb6f1f0 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_options: 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: capacity : 536870912 2024-09-19T08:52:55.345 INFO:journalctl@ceph.mon.a.smithi083.stdout: num_shard_bits : 4 2024-09-19T08:52:55.346 INFO:journalctl@ceph.mon.a.smithi083.stdout: strict_capacity_limit : 0 2024-09-19T08:52:55.346 INFO:journalctl@ceph.mon.a.smithi083.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:52:55.346 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_compressed: (nil) 2024-09-19T08:52:55.346 INFO:journalctl@ceph.mon.a.smithi083.stdout: persistent_cache: (nil) 2024-09-19T08:52:55.346 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_size: 4096 2024-09-19T08:52:55.346 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_size_deviation: 10 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_restart_interval: 16 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_block_restart_interval: 1 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: metadata_block_size: 4096 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: partition_filters: 0 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: use_delta_encoding: 1 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: filter_policy: bloomfilter 2024-09-19T08:52:55.347 INFO:journalctl@ceph.mon.a.smithi083.stdout: whole_key_filtering: 1 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: verify_compression: 0 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: format_version: 5 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: enable_index_compression: 1 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_align: 0 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: max_auto_readahead_size: 262144 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: prepopulate_block_cache: 0 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:52:55.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression: NoCompression 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.num_levels: 7 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:52:55.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:52:55.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:52:55.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:52:55.352 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:52:55.353 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:52:55.354 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.ttl: 2592000 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:52:55.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 825c87b7-36a7-4246-8b25-1053d29a639c 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735975087651, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735975088659, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100261, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98149, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14274, "raw_average_key_size": 49, "raw_value_size": 90385, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735975, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "825c87b7-36a7-4246-8b25-1053d29a639c", "db_session_id": "6FFZ07M4FU5ZK7YAD2MT", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735975088753, "job": 1, "event": "recovery_finished"} 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564f2bb9ce00 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: DB pointer 0x564f2bc98000 2024-09-19T08:52:55.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** DB Stats ** 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:52:55.357 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** Compaction Stats [default] ** 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: L0 2/0 99.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: Sum 2/0 99.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** Compaction Stats [default] ** 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:52:55.358 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:52:55.359 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative compaction: 0.00 GB write, 30.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval compaction: 0.00 GB write, 30.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: Block cache BinnedLRUCache@0x564f2bb6f1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:52:55.360 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: starting mon.a rank 0 at public addrs [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] at bind addrs [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???) e1 preinit fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).mds e1 new map 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: e1 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: btime 2024-09-19T08:52:50:113112+0000 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: legacy client fscid: -1 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout: No filesystems configured 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:52:55.361 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 bash[30906]: 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 systemd[1]: Started Ceph mon.a for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: monmap epoch 1 2024-09-19T08:52:55.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: last_changed 2024-09-19T08:52:47.071352+0000 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: min_mon_release 19 (squid) 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: election_strategy: 1 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: fsmap 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:52:55.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:55 smithi083 ceph-mon[30926]: mgrmap e1: no daemons active 2024-09-19T08:52:56.158 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.525+0000 7f131c278640 1 Processor -- start 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.525+0000 7f131c278640 1 -- start start 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.526+0000 7f131c278640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.526+0000 7f131c278640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1314106e20 con 0x7f1314106450 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.526+0000 7f131a014640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.526+0000 7f131a014640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40060/0 (socket says 172.21.15.83:40060) 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.526+0000 7f131a014640 1 -- 172.21.15.83:0/3120950951 learned_addr learned my addr 172.21.15.83:0/3120950951 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.526+0000 7f131a014640 1 -- 172.21.15.83:0/3120950951 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1314107650 con 0x7f1314106450 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.528+0000 7f131a014640 1 --2- 172.21.15.83:0/3120950951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314106850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1310009820 tx=0x7f131002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb49a1cc7117cba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.528+0000 7f1319012640 1 -- 172.21.15.83:0/3120950951 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1310037070 con 0x7f1314106450 2024-09-19T08:52:56.163 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.528+0000 7f1319012640 1 -- 172.21.15.83:0/3120950951 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f13100328d0 con 0x7f1314106450 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.528+0000 7f1319012640 1 -- 172.21.15.83:0/3120950951 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13100307d0 con 0x7f1314106450 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 -- 172.21.15.83:0/3120950951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 msgr2=0x7f1314106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 --2- 172.21.15.83:0/3120950951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314106850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1310009820 tx=0x7f131002a270 comp rx=0 tx=0).stop 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 -- 172.21.15.83:0/3120950951 shutdown_connections 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 --2- 172.21.15.83:0/3120950951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314106850 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 -- 172.21.15.83:0/3120950951 >> 172.21.15.83:0/3120950951 conn(0x7f1314101c60 msgr2=0x7f1314104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 -- 172.21.15.83:0/3120950951 shutdown_connections 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 -- 172.21.15.83:0/3120950951 wait complete. 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.529+0000 7f131c278640 1 Processor -- start 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131c278640 1 -- start start 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131c278640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314191680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131c278640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f131410aa00 con 0x7f1314106450 2024-09-19T08:52:56.164 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131a014640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314191680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131a014640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314191680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40076/0 (socket says 172.21.15.83:40076) 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131a014640 1 -- 172.21.15.83:0/4015677306 learned_addr learned my addr 172.21.15.83:0/4015677306 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131a014640 1 -- 172.21.15.83:0/4015677306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1314191bc0 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131a014640 1 --2- 172.21.15.83:0/4015677306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314191680 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1310009940 tx=0x7f1310032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1310042070 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1310030c80 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1310037040 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131418fdb0 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.530+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13141902f0 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.531+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1310045070 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.531+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f13100479f0 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.531+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131410ab80 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.533+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f131003c5f0 con 0x7f1314106450 2024-09-19T08:52:56.165 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.591+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f1314194f90 con 0x7f1314106450 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.596+0000 7f130b7fe640 1 -- 172.21.15.83:0/4015677306 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f131003c7d0 con 0x7f1314106450 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.596+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 msgr2=0x7f1314191680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.596+0000 7f131c278640 1 --2- 172.21.15.83:0/4015677306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314191680 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1310009940 tx=0x7f1310032e10 comp rx=0 tx=0).stop 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.596+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 shutdown_connections 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.596+0000 7f131c278640 1 --2- 172.21.15.83:0/4015677306 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1314106450 0x7f1314191680 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.597+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 >> 172.21.15.83:0/4015677306 conn(0x7f1314101c60 msgr2=0x7f1314102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.597+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 shutdown_connections 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:55.597+0000 7f131c278640 1 -- 172.21.15.83:0/4015677306 wait complete. 2024-09-19T08:52:56.166 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:52:56.188 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:52:56.189 INFO:teuthology.orchestra.run.smithi083.stdout:Creating mgr... 2024-09-19T08:52:56.189 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:52:56.189 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:52:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:52:56.452 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to reset failed state of unit ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:52:56.598 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-68681c4c-7664-11ef-bceb-c7b262605968.target.wants/ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-68681c4c-7664-11ef-bceb-c7b262605968@.service. 2024-09-19T08:52:56.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:56 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4015677306' entity='client.admin' 2024-09-19T08:52:56.711 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:56 smithi083 systemd[1]: Starting Ceph mgr.x for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T08:52:57.102 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:56 smithi083 podman[31139]: 2024-09-19 08:52:56.817084298 +0000 UTC m=+0.100822688 container create f631a58ea8659e9d27c776be977e36f6c6387f371550a8d4645ecc96205b26ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:52:57.102 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:56 smithi083 podman[31139]: 2024-09-19 08:52:56.731743785 +0000 UTC m=+0.015482142 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:52:57.102 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 podman[31139]: 2024-09-19 08:52:57.027546667 +0000 UTC m=+0.311285014 container init f631a58ea8659e9d27c776be977e36f6c6387f371550a8d4645ecc96205b26ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:52:57.102 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 podman[31139]: 2024-09-19 08:52:57.030288359 +0000 UTC m=+0.314026709 container start f631a58ea8659e9d27c776be977e36f6c6387f371550a8d4645ecc96205b26ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:52:57.102 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 bash[31139]: f631a58ea8659e9d27c776be977e36f6c6387f371550a8d4645ecc96205b26ce 2024-09-19T08:52:57.115 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:52:57.115 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-19T08:52:57.123 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:52:57.123 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-19T08:52:57.123 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-19T08:52:57.123 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:52:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:52:57.132 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-19T08:52:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:52:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-19T08:52:57.139 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr to start... 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr... 2024-09-19T08:52:57.366 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 systemd[1]: Started Ceph mgr.x for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:52:57.367 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:57.152+0000 7fe7d133a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:52:57.367 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:57.211+0000 7fe7d133a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:52:57.367 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:57.366+0000 7fe7d133a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:52:57.638 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:57.433+0000 7fe7d133a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:52:57.638 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:57.590+0000 7fe7d133a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:52:57.925 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:57.736+0000 7fe7d133a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:52:57.925 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:52:57 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2319673605' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:52:58.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:58.056+0000 7fe7d133a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:52:58.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:58.117+0000 7fe7d133a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:52:58.219 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:52:58.221 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:52:58.221 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:52:58.222 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:52:58.223 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:52:58.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:52:58.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:52:58.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:52:58.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:52:50:113112+0000", 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:52:58.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:52:58.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:52:50.113778+0000", 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.567+0000 7f79f48c8640 1 Processor -- start 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.567+0000 7f79f48c8640 1 -- start start 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.567+0000 7f79f48c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f010a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.567+0000 7f79f48c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79f0075980 con 0x7f79f0107fc0 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.568+0000 7f79ee59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f010a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.568+0000 7f79ee59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f010a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40118/0 (socket says 172.21.15.83:40118) 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.568+0000 7f79ee59c640 1 -- 172.21.15.83:0/289921842 learned_addr learned my addr 172.21.15.83:0/289921842 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.568+0000 7f79ee59c640 1 -- 172.21.15.83:0/289921842 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f010a8f0 con 0x7f79f0107fc0 2024-09-19T08:52:58.233 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.568+0000 7f79ee59c640 1 --2- 172.21.15.83:0/289921842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f010a3b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009820 tx=0x7f79e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a980a0b5d181cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.569+0000 7f79ed59a640 1 -- 172.21.15.83:0/289921842 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79e0037070 con 0x7f79f0107fc0 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.569+0000 7f79ed59a640 1 -- 172.21.15.83:0/289921842 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f79e00328d0 con 0x7f79f0107fc0 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.569+0000 7f79ed59a640 1 -- 172.21.15.83:0/289921842 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79e00307d0 con 0x7f79f0107fc0 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 -- 172.21.15.83:0/289921842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 msgr2=0x7f79f010a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 --2- 172.21.15.83:0/289921842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f010a3b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009820 tx=0x7f79e002a270 comp rx=0 tx=0).stop 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 -- 172.21.15.83:0/289921842 shutdown_connections 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 --2- 172.21.15.83:0/289921842 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f010a3b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 -- 172.21.15.83:0/289921842 >> 172.21.15.83:0/289921842 conn(0x7f79f0101c60 msgr2=0x7f79f0104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 -- 172.21.15.83:0/289921842 shutdown_connections 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.570+0000 7f79f48c8640 1 -- 172.21.15.83:0/289921842 wait complete. 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79f48c8640 1 Processor -- start 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79f48c8640 1 -- start start 2024-09-19T08:52:58.234 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79f48c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79f48c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79f010b930 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79ee59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79ee59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40126/0 (socket says 172.21.15.83:40126) 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.571+0000 7f79ee59c640 1 -- 172.21.15.83:0/2319673605 learned_addr learned my addr 172.21.15.83:0/2319673605 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79ee59c640 1 -- 172.21.15.83:0/2319673605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f019ba20 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79ee59c640 1 --2- 172.21.15.83:0/2319673605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f019b4e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79e0032e10 tx=0x7f79e0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79e0042070 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f019bcb0 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f79e0030c80 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79e0037040 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f019e9a0 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79e0045070 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.572+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f79e00463b0 con 0x7f79f0107fc0 2024-09-19T08:52:58.235 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.573+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f0108420 con 0x7f79f0107fc0 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.577+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f79e00465b0 con 0x7f79f0107fc0 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.638+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f79f019eb70 con 0x7f79f0107fc0 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.638+0000 7f79df7fe640 1 -- 172.21.15.83:0/2319673605 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f79e003c700 con 0x7f79f0107fc0 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.639+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 msgr2=0x7f79f019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.639+0000 7f79f48c8640 1 --2- 172.21.15.83:0/2319673605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f019b4e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79e0032e10 tx=0x7f79e0032e40 comp rx=0 tx=0).stop 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.639+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 shutdown_connections 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.639+0000 7f79f48c8640 1 --2- 172.21.15.83:0/2319673605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79f0107fc0 0x7f79f019b4e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.639+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 >> 172.21.15.83:0/2319673605 conn(0x7f79f0101c60 msgr2=0x7f79f01027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.639+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 shutdown_connections 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:52:57.640+0000 7f79f48c8640 1 -- 172.21.15.83:0/2319673605 wait complete. 2024-09-19T08:52:58.236 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:52:58.711 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:58.305+0000 7fe7d133a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:52:59.461 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:59.179+0000 7fe7d133a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:52:59.461 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:59.247+0000 7fe7d133a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:53:00.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:52:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:52:59.964+0000 7fe7d133a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:53:00.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.079+0000 7fe7d133a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:53:00.487 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.222+0000 7fe7d133a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:53:00.487 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.287+0000 7fe7d133a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:53:00.487 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.437+0000 7fe7d133a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:53:00.745 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.515+0000 7fe7d133a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:53:00.745 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.577+0000 7fe7d133a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:53:00.745 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.745+0000 7fe7d133a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:53:01.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3839390838' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:53:01.026 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.816+0000 7fe7d133a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:53:01.026 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.883+0000 7fe7d133a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:53:01.026 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:00.964+0000 7fe7d133a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:53:01.027 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:01.026+0000 7fe7d133a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:53:01.408 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:01.087+0000 7fe7d133a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:53:01.411 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:53:01.412 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:53:01.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:53:01.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:52:50:113112+0000", 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:53:01.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:52:50.113778+0000", 2024-09-19T08:53:01.426 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.680+0000 7fbdc6f74640 1 Processor -- start 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.680+0000 7fbdc6f74640 1 -- start start 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.680+0000 7fbdc6f74640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc01079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.680+0000 7fbdc6f74640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0107fa0 con 0x7fbdc01075d0 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.681+0000 7fbdc4d10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc01079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.681+0000 7fbdc4d10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc01079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48428/0 (socket says 172.21.15.83:48428) 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.681+0000 7fbdc4d10640 1 -- 172.21.15.83:0/1686156070 learned_addr learned my addr 172.21.15.83:0/1686156070 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.681+0000 7fbdc4d10640 1 -- 172.21.15.83:0/1686156070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc01087d0 con 0x7fbdc01075d0 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.682+0000 7fbdc4d10640 1 --2- 172.21.15.83:0/1686156070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc01079d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009820 tx=0x7fbdb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcf11227fa1003e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:01.427 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.682+0000 7fbdbf7fe640 1 -- 172.21.15.83:0/1686156070 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4037070 con 0x7fbdc01075d0 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.682+0000 7fbdbf7fe640 1 -- 172.21.15.83:0/1686156070 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbdb40328d0 con 0x7fbdc01075d0 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.682+0000 7fbdbf7fe640 1 -- 172.21.15.83:0/1686156070 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb40307d0 con 0x7fbdc01075d0 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 -- 172.21.15.83:0/1686156070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 msgr2=0x7fbdc01079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 --2- 172.21.15.83:0/1686156070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc01079d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009820 tx=0x7fbdb402a270 comp rx=0 tx=0).stop 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 -- 172.21.15.83:0/1686156070 shutdown_connections 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 --2- 172.21.15.83:0/1686156070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc01079d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 -- 172.21.15.83:0/1686156070 >> 172.21.15.83:0/1686156070 conn(0x7fbdc0102d40 msgr2=0x7fbdc01051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 -- 172.21.15.83:0/1686156070 shutdown_connections 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 -- 172.21.15.83:0/1686156070 wait complete. 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 Processor -- start 2024-09-19T08:53:01.428 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.683+0000 7fbdc6f74640 1 -- start start 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc6f74640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc007ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc6f74640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc010bb80 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc4d10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc007ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc4d10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc007ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48440/0 (socket says 172.21.15.83:48440) 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc4d10640 1 -- 172.21.15.83:0/3839390838 learned_addr learned my addr 172.21.15.83:0/3839390838 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc4d10640 1 -- 172.21.15.83:0/3839390838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc007cfb0 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc4d10640 1 --2- 172.21.15.83:0/3839390838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc007ca70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009940 tx=0x7fbdb4032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4042070 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbdb4030c80 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc007b1a0 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.684+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4037040 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.685+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc007b6e0 con 0x7fbdc01075d0 2024-09-19T08:53:01.429 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.685+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbdb4045070 con 0x7fbdc01075d0 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.685+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbdb40479e0 con 0x7fbdc01075d0 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.685+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc010bd00 con 0x7fbdc01075d0 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.689+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbdb403c5f0 con 0x7fbdc01075d0 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.750+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbdc007be10 con 0x7fbdc01075d0 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.751+0000 7fbdbdffb640 1 -- 172.21.15.83:0/3839390838 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fbdb403c7d0 con 0x7fbdc01075d0 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.751+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 msgr2=0x7fbdc007ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.751+0000 7fbdc6f74640 1 --2- 172.21.15.83:0/3839390838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc007ca70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009940 tx=0x7fbdb4032e10 comp rx=0 tx=0).stop 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.752+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 shutdown_connections 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.752+0000 7fbdc6f74640 1 --2- 172.21.15.83:0/3839390838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc01075d0 0x7fbdc007ca70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.752+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 >> 172.21.15.83:0/3839390838 conn(0x7fbdc0102d40 msgr2=0x7fbdc0103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.752+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 shutdown_connections 2024-09-19T08:53:01.430 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:00.752+0000 7fbdc6f74640 1 -- 172.21.15.83:0/3839390838 wait complete. 2024-09-19T08:53:01.431 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:53:02.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:01.877+0000 7fe7d133a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:53:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: Activating manager daemon x 2024-09-19T08:53:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: mgrmap e2: x(active, starting, since 0.00293635s) 2024-09-19T08:53:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:53:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: Manager daemon x is now available 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' 2024-09-19T08:53:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:01 smithi083 ceph-mon[30926]: from='mgr.14100 172.21.15.83:0/2102400536' entity='mgr.x' 2024-09-19T08:53:04.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:03 smithi083 ceph-mon[30926]: mgrmap e3: x(active, since 1.00652s) 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:53:04.651 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.652 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:53:04.653 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:04.653 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:53:04.653 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:53:04.653 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:53:04.661 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:53:04.661 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:53:04.661 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:53:04.661 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.661 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:53:04.661 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:52:50:113112+0000", 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:53:04.662 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:52:50.113778+0000", 2024-09-19T08:53:04.663 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.825+0000 7f0c2b8ab640 1 Processor -- start 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.825+0000 7f0c2b8ab640 1 -- start start 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.825+0000 7f0c2b8ab640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2410a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.826+0000 7f0c2b8ab640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24075920 con 0x7f0c24108020 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.826+0000 7f0c29647640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2410a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.826+0000 7f0c29647640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2410a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48532/0 (socket says 172.21.15.83:48532) 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.826+0000 7f0c29647640 1 -- 172.21.15.83:0/2057319856 learned_addr learned my addr 172.21.15.83:0/2057319856 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.826+0000 7f0c29647640 1 -- 172.21.15.83:0/2057319856 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2410a950 con 0x7f0c24108020 2024-09-19T08:53:04.664 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c29647640 1 --2- 172.21.15.83:0/2057319856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2410a410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009820 tx=0x7f0c2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166bd1c12780ff16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c1bfff640 1 -- 172.21.15.83:0/2057319856 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c20037070 con 0x7f0c24108020 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c1bfff640 1 -- 172.21.15.83:0/2057319856 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0c200328d0 con 0x7f0c24108020 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c1bfff640 1 -- 172.21.15.83:0/2057319856 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c200307d0 con 0x7f0c24108020 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/2057319856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 msgr2=0x7f0c2410a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c2b8ab640 1 --2- 172.21.15.83:0/2057319856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2410a410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009820 tx=0x7f0c2002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/2057319856 shutdown_connections 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c2b8ab640 1 --2- 172.21.15.83:0/2057319856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2410a410 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.827+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/2057319856 >> 172.21.15.83:0/2057319856 conn(0x7f0c24101c60 msgr2=0x7f0c24104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/2057319856 shutdown_connections 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/2057319856 wait complete. 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c2b8ab640 1 Processor -- start 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c2b8ab640 1 -- start start 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c2b8ab640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:04.665 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c2b8ab640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2410b930 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c29647640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c29647640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48540/0 (socket says 172.21.15.83:48540) 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.828+0000 7f0c29647640 1 -- 172.21.15.83:0/300451699 learned_addr learned my addr 172.21.15.83:0/300451699 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c29647640 1 -- 172.21.15.83:0/300451699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2419ba30 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c29647640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2419b4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0c20032e10 tx=0x7f0c20032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c20042070 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0c20030c80 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2419bcc0 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c20037040 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.829+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2419e9b0 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.830+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f0c20045070 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.830+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c24108480 con 0x7f0c24108020 2024-09-19T08:53:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.830+0000 7f0c1a7fc640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7f0c100390a0 0x7f0c1003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.830+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0c2006c000 con 0x7f0c24108020 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.830+0000 7f0c28e46640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7f0c100390a0 0x7f0c1003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.831+0000 7f0c28e46640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7f0c100390a0 0x7f0c1003b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0c140098c0 tx=0x7f0c14006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.835+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c20045360 con 0x7f0c24108020 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.886+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f0c2003cac0 con 0x7f0c24108020 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.067+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0c2419ef90 con 0x7f0c24108020 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.068+0000 7f0c1a7fc640 1 -- 172.21.15.83:0/300451699 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f0c200392e0 con 0x7f0c24108020 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7f0c100390a0 msgr2=0x7f0c1003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7f0c100390a0 0x7f0c1003b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0c140098c0 tx=0x7f0c14006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 msgr2=0x7f0c2419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2419b4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0c20032e10 tx=0x7f0c20032e40 comp rx=0 tx=0).stop 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 shutdown_connections 2024-09-19T08:53:04.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7f0c100390a0 0x7f0c1003b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 --2- 172.21.15.83:0/300451699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c24108020 0x7f0c2419b4f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 >> 172.21.15.83:0/300451699 conn(0x7f0c24101c60 msgr2=0x7f0c241027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:04.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 shutdown_connections 2024-09-19T08:53:04.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:04.070+0000 7f0c2b8ab640 1 -- 172.21.15.83:0/300451699 wait complete. 2024-09-19T08:53:04.668 INFO:teuthology.orchestra.run.smithi083.stdout:mgr is available 2024-09-19T08:53:05.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:04 smithi083 ceph-mon[30926]: mgrmap e4: x(active, since 2s) 2024-09-19T08:53:05.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:04 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/300451699' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:53:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:05 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4008499415' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:53:11.226 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:11.226 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:53:11.226 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout fsid = 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:11.226 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:53:11.227 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.076+0000 7fc522933640 1 Processor -- start 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.076+0000 7fc522933640 1 -- start start 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.076+0000 7fc522933640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c1068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.076+0000 7fc522933640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c106e80 con 0x7fc51c1064b0 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.077+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c1068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.077+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c1068b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48548/0 (socket says 172.21.15.83:48548) 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.077+0000 7fc51bfff640 1 -- 172.21.15.83:0/3723504717 learned_addr learned my addr 172.21.15.83:0/3723504717 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.077+0000 7fc51bfff640 1 -- 172.21.15.83:0/3723504717 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c1076b0 con 0x7fc51c1064b0 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc51bfff640 1 --2- 172.21.15.83:0/3723504717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c1068b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009820 tx=0x7fc50c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238bb6bac4e7381 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc51affd640 1 -- 172.21.15.83:0/3723504717 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c037070 con 0x7fc51c1064b0 2024-09-19T08:53:11.228 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc51affd640 1 -- 172.21.15.83:0/3723504717 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc50c0328d0 con 0x7fc51c1064b0 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc51affd640 1 -- 172.21.15.83:0/3723504717 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c0307d0 con 0x7fc51c1064b0 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 -- 172.21.15.83:0/3723504717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 msgr2=0x7fc51c1068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 --2- 172.21.15.83:0/3723504717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c1068b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009820 tx=0x7fc50c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 -- 172.21.15.83:0/3723504717 shutdown_connections 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 --2- 172.21.15.83:0/3723504717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c1068b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 -- 172.21.15.83:0/3723504717 >> 172.21.15.83:0/3723504717 conn(0x7fc51c101cc0 msgr2=0x7fc51c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 -- 172.21.15.83:0/3723504717 shutdown_connections 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.078+0000 7fc522933640 1 -- 172.21.15.83:0/3723504717 wait complete. 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc522933640 1 Processor -- start 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc522933640 1 -- start start 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc522933640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c075520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.229 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc522933640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c10aa60 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c075520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c075520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48552/0 (socket says 172.21.15.83:48552) 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.079+0000 7fc51bfff640 1 -- 172.21.15.83:0/4008499415 learned_addr learned my addr 172.21.15.83:0/4008499415 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc51bfff640 1 -- 172.21.15.83:0/4008499415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c19c0b0 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc51bfff640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c075520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0097f0 tx=0x7fc50c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c037040 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc50c032bb0 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51c1a06c0 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c03a390 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.080+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51c1a0a60 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.081+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fc50c03a5d0 con 0x7fc51c1064b0 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.081+0000 7fc5197fa640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fc504039160 0x7fc50403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.230 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.081+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc50c06c5b0 con 0x7fc51c1064b0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.081+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51c106930 con 0x7fc51c1064b0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.081+0000 7fc51b7fe640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fc504039160 0x7fc50403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.082+0000 7fc51b7fe640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fc504039160 0x7fc50403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc5100098c0 tx=0x7fc510006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.086+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc50c032dd0 con 0x7fc51c1064b0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.252+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc51c1a0ce0 con 0x7fc51c1064b0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.253+0000 7fc5197fa640 1 -- 172.21.15.83:0/4008499415 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+454 (secure 0 0 0) 0x7fc50c031560 con 0x7fc51c1064b0 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.255+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fc504039160 msgr2=0x7fc50403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.255+0000 7fc522933640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fc504039160 0x7fc50403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc5100098c0 tx=0x7fc510006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.255+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 msgr2=0x7fc51c075520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.255+0000 7fc522933640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c075520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0097f0 tx=0x7fc50c030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.256+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 shutdown_connections 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.256+0000 7fc522933640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fc504039160 0x7fc50403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.256+0000 7fc522933640 1 --2- 172.21.15.83:0/4008499415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc51c1064b0 0x7fc51c075520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.256+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 >> 172.21.15.83:0/4008499415 conn(0x7fc51c101cc0 msgr2=0x7fc51c102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.256+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 shutdown_connections 2024-09-19T08:53:11.232 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:05.256+0000 7fc522933640 1 -- 172.21.15.83:0/4008499415 wait complete. 2024-09-19T08:53:11.232 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling cephadm module... 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2169747300' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ignoring --setuser ceph since I am not root 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ignoring --setgroup ceph since I am not root 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:14.724+0000 7f8c268ed040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:14.781+0000 7f8c268ed040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:14.927+0000 7f8c268ed040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:53:15.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:14 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:14.995+0000 7f8c268ed040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:53:15.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:15.143+0000 7f8c268ed040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:53:15.591 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:15.285+0000 7f8c268ed040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:53:15.849 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2169747300' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:53:15.849 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-mon[30926]: mgrmap e5: x(active, since 12s) 2024-09-19T08:53:15.850 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:15.601+0000 7f8c268ed040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:53:15.850 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:15.662+0000 7f8c268ed040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:53:15.850 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:15 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:15.849+0000 7f8c268ed040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:53:17.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:16 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:16.733+0000 7f8c268ed040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:53:17.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:16 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:16.800+0000 7f8c268ed040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:53:17.771 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:17 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:17.508+0000 7f8c268ed040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:53:17.771 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:17 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:17.623+0000 7f8c268ed040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:53:18.052 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:17 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:17.770+0000 7f8c268ed040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:53:18.052 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:17 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:17.831+0000 7f8c268ed040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:53:18.052 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:17 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:17.982+0000 7f8c268ed040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:53:18.052 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.051+0000 7f8c268ed040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:53:18.231 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.312+0000 7ff5a9623640 1 Processor -- start 2024-09-19T08:53:18.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.312+0000 7ff5a9623640 1 -- start start 2024-09-19T08:53:18.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.312+0000 7ff5a9623640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a410a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.312+0000 7ff5a9623640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4075980 con 0x7ff5a4107fc0 2024-09-19T08:53:18.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.313+0000 7ff5a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a410a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.236 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.313+0000 7ff5a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a410a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55458/0 (socket says 172.21.15.83:55458) 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.313+0000 7ff5a2ffd640 1 -- 172.21.15.83:0/3144256760 learned_addr learned my addr 172.21.15.83:0/3144256760 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.313+0000 7ff5a2ffd640 1 -- 172.21.15.83:0/3144256760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a410a8f0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a2ffd640 1 --2- 172.21.15.83:0/3144256760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a410a3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff594009820 tx=0x7ff59402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee44c7e81231479a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a27fc640 1 -- 172.21.15.83:0/3144256760 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594037070 con 0x7ff5a4107fc0 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a27fc640 1 -- 172.21.15.83:0/3144256760 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff5940328d0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a27fc640 1 -- 172.21.15.83:0/3144256760 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5940307d0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a9623640 1 -- 172.21.15.83:0/3144256760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 msgr2=0x7ff5a410a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a9623640 1 --2- 172.21.15.83:0/3144256760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a410a3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff594009820 tx=0x7ff59402a270 comp rx=0 tx=0).stop 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a9623640 1 -- 172.21.15.83:0/3144256760 shutdown_connections 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a9623640 1 --2- 172.21.15.83:0/3144256760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a410a3b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.314+0000 7ff5a9623640 1 -- 172.21.15.83:0/3144256760 >> 172.21.15.83:0/3144256760 conn(0x7ff5a4101c60 msgr2=0x7ff5a4104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a9623640 1 -- 172.21.15.83:0/3144256760 shutdown_connections 2024-09-19T08:53:18.237 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a9623640 1 -- 172.21.15.83:0/3144256760 wait complete. 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a9623640 1 Processor -- start 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a9623640 1 -- start start 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a9623640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a9623640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a410b930 con 0x7ff5a4107fc0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.315+0000 7ff5a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55464/0 (socket says 172.21.15.83:55464) 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a2ffd640 1 -- 172.21.15.83:0/2169747300 learned_addr learned my addr 172.21.15.83:0/2169747300 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a2ffd640 1 -- 172.21.15.83:0/2169747300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a419ba20 con 0x7ff5a4107fc0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a2ffd640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a419b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff594032e10 tx=0x7ff594032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594042070 con 0x7ff5a4107fc0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff594030c80 con 0x7ff5a4107fc0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a419bcb0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594037040 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.316+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a419e9a0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.317+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ff594045070 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.317+0000 7ff5a0ff9640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7ff590039160 0x7ff59003b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.317+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a4108420 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.317+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff59406c0d0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.317+0000 7ff59bfff640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7ff590039160 0x7ff59003b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.318+0000 7ff59bfff640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7ff590039160 0x7ff59003b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0098c0 tx=0x7ff58c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.322+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff594045360 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.535+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff5a419eb70 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.587+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff5a419eb70 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.588+0000 7ff5a0ff9640 1 -- 172.21.15.83:0/2169747300 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7ff5940313a0 con 0x7ff5a4107fc0 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7ff590039160 msgr2=0x7ff59003b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:18.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7ff590039160 0x7ff59003b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0098c0 tx=0x7ff58c006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 msgr2=0x7ff5a419b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a419b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff594032e10 tx=0x7ff594032e40 comp rx=0 tx=0).stop 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 shutdown_connections 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7ff590039160 0x7ff59003b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 --2- 172.21.15.83:0/2169747300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5a4107fc0 0x7ff5a419b4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 >> 172.21.15.83:0/2169747300 conn(0x7ff5a4101c60 msgr2=0x7ff5a41027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 shutdown_connections 2024-09-19T08:53:18.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.590+0000 7ff5a9623640 1 -- 172.21.15.83:0/2169747300 wait complete. 2024-09-19T08:53:18.341 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.111+0000 7f8c268ed040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:53:18.341 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.274+0000 7f8c268ed040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:53:18.341 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.340+0000 7f8c268ed040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:53:18.593 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.408+0000 7f8c268ed040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:53:18.594 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.492+0000 7f8c268ed040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:53:18.594 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.553+0000 7f8c268ed040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:53:18.873 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:18.614+0000 7f8c268ed040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:53:19.193 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:18 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/605084616' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:53:19.461 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:19.426+0000 7f8c268ed040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.667+0000 7fba637af640 1 Processor -- start 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.667+0000 7fba637af640 1 -- start start 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.667+0000 7fba637af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c10a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.667+0000 7fba637af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c075940 con 0x7fba5c108000 2024-09-19T08:53:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.668+0000 7fba6154b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c10a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.668+0000 7fba6154b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c10a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55496/0 (socket says 172.21.15.83:55496) 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.668+0000 7fba6154b640 1 -- 172.21.15.83:0/3102310735 learned_addr learned my addr 172.21.15.83:0/3102310735 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.668+0000 7fba6154b640 1 -- 172.21.15.83:0/3102310735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c10a930 con 0x7fba5c108000 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.669+0000 7fba6154b640 1 --2- 172.21.15.83:0/3102310735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c10a3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba58009820 tx=0x7fba5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9696147c55359c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.669+0000 7fba4ffff640 1 -- 172.21.15.83:0/3102310735 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba58037070 con 0x7fba5c108000 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.669+0000 7fba4ffff640 1 -- 172.21.15.83:0/3102310735 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fba580328d0 con 0x7fba5c108000 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.669+0000 7fba4ffff640 1 -- 172.21.15.83:0/3102310735 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba580307d0 con 0x7fba5c108000 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- 172.21.15.83:0/3102310735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 msgr2=0x7fba5c10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 --2- 172.21.15.83:0/3102310735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c10a3f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba58009820 tx=0x7fba5802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- 172.21.15.83:0/3102310735 shutdown_connections 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 --2- 172.21.15.83:0/3102310735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c10a3f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- 172.21.15.83:0/3102310735 >> 172.21.15.83:0/3102310735 conn(0x7fba5c101c60 msgr2=0x7fba5c104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:19.487 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- 172.21.15.83:0/3102310735 shutdown_connections 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- 172.21.15.83:0/3102310735 wait complete. 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 Processor -- start 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- start start 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c107880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.670+0000 7fba637af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c10b910 con 0x7fba5c108000 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba6154b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c107880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba6154b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c107880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55508/0 (socket says 172.21.15.83:55508) 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba6154b640 1 -- 172.21.15.83:0/605084616 learned_addr learned my addr 172.21.15.83:0/605084616 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba6154b640 1 -- 172.21.15.83:0/605084616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c107dc0 con 0x7fba5c108000 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba6154b640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c107880 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba58032e10 tx=0x7fba58032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba58042070 con 0x7fba5c108000 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fba58030c80 con 0x7fba5c108000 2024-09-19T08:53:19.488 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c105fb0 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba58037040 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.671+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1064f0 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.672+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fba58045070 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.672+0000 7fba4e7fc640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 0x7fba4803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.672+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c108460 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.672+0000 7fba60d4a640 1 -- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 msgr2=0x7fba4803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3693558817 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.672+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba5806c270 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.672+0000 7fba60d4a640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 0x7fba4803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.677+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba58045360 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.873+0000 7fba60d4a640 1 -- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 msgr2=0x7fba4803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3693558817 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.873+0000 7fba60d4a640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 0x7fba4803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.895+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fba5c106d30 con 0x7fba5c108000 2024-09-19T08:53:19.489 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.895+0000 7fba4e7fc640 1 -- 172.21.15.83:0/605084616 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fba5803cac0 con 0x7fba5c108000 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.897+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 msgr2=0x7fba4803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.897+0000 7fba637af640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 0x7fba4803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.897+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 msgr2=0x7fba5c107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.897+0000 7fba637af640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c107880 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fba58032e10 tx=0x7fba58032e40 comp rx=0 tx=0).stop 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.898+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 shutdown_connections 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.898+0000 7fba637af640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:6800/3693558817,v1:172.21.15.83:6801/3693558817] conn(0x7fba48039200 0x7fba4803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.898+0000 7fba637af640 1 --2- 172.21.15.83:0/605084616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fba5c108000 0x7fba5c107880 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.898+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 >> 172.21.15.83:0/605084616 conn(0x7fba5c101c60 msgr2=0x7fba5c1027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.898+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 shutdown_connections 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:18.898+0000 7fba637af640 1 -- 172.21.15.83:0/605084616 wait complete. 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for the mgr to restart... 2024-09-19T08:53:19.490 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr epoch 5... 2024-09-19T08:53:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: Active manager daemon x restarted 2024-09-19T08:53:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: Activating manager daemon x 2024-09-19T08:53:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:53:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: mgrmap e6: x(active, starting, since 0.00357291s) 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: Manager daemon x is now available 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:53:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:20.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:19 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:20.812+0000 7f8b8dc47640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:53:20] ENGINE Error in HTTPServer.serve 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: Traceback (most recent call last): 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._connections.run(self.expiration_interval) 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._run(expiration_interval) 2024-09-19T08:53:21.001 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: s = self.context.wrap_socket( 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: return self.sslsocket_class._create( 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self.do_handshake() 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._sslobj.do_handshake() 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:53:21.002 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:20 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:53:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:53:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.873+0000 7fc7b4a65640 1 Processor -- start 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.873+0000 7fc7b4a65640 1 -- start start 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.873+0000 7fc7b4a65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b010a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.873+0000 7fc7b4a65640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0075940 con 0x7fc7b0108010 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.874+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b010a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.874+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b010a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55562/0 (socket says 172.21.15.83:55562) 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.874+0000 7fc7ae59c640 1 -- 172.21.15.83:0/3935651482 learned_addr learned my addr 172.21.15.83:0/3935651482 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.874+0000 7fc7ae59c640 1 -- 172.21.15.83:0/3935651482 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b010a940 con 0x7fc7b0108010 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7ae59c640 1 --2- 172.21.15.83:0/3935651482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b010a400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009820 tx=0x7fc7a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5f24f39969e843 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7ad59a640 1 -- 172.21.15.83:0/3935651482 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a0037070 con 0x7fc7b0108010 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7ad59a640 1 -- 172.21.15.83:0/3935651482 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc7a00328d0 con 0x7fc7b0108010 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7ad59a640 1 -- 172.21.15.83:0/3935651482 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a00307d0 con 0x7fc7b0108010 2024-09-19T08:53:21.009 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 -- 172.21.15.83:0/3935651482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 msgr2=0x7fc7b010a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 --2- 172.21.15.83:0/3935651482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b010a400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009820 tx=0x7fc7a002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 -- 172.21.15.83:0/3935651482 shutdown_connections 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 --2- 172.21.15.83:0/3935651482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b010a400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 -- 172.21.15.83:0/3935651482 >> 172.21.15.83:0/3935651482 conn(0x7fc7b0101c70 msgr2=0x7fc7b0104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 -- 172.21.15.83:0/3935651482 shutdown_connections 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.875+0000 7fc7b4a65640 1 -- 172.21.15.83:0/3935651482 wait complete. 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.876+0000 7fc7b4a65640 1 Processor -- start 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.876+0000 7fc7b4a65640 1 -- start start 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.876+0000 7fc7b4a65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.876+0000 7fc7b4a65640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b010b920 con 0x7fc7b0108010 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b019b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55570/0 (socket says 172.21.15.83:55570) 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7ae59c640 1 -- 172.21.15.83:0/1616795291 learned_addr learned my addr 172.21.15.83:0/1616795291 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:21.010 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7ae59c640 1 -- 172.21.15.83:0/1616795291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b019ba60 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7ae59c640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b019b520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0032e10 tx=0x7fc7a0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a0042070 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc7a0030c80 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b019bcf0 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a0037040 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.877+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b019e9e0 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.878+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fc7a0045070 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:19.878+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc7a006bec0 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.431+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fc7a006abe0 con 0x7fc7b0108010 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.431+0000 7fc79f7fe640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc798039cf0 0x7fc79803c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.431+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7a002bba0 con 0x7fc798039cf0 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.431+0000 7fc7add9b640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc798039cf0 0x7fc79803c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:21.011 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.432+0000 7fc7add9b640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc798039cf0 0x7fc79803c0e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40098c0 tx=0x7fc7a4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.432+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc7a002bba0 con 0x7fc798039cf0 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.439+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc7b0108470 con 0x7fc798039cf0 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.439+0000 7fc79f7fe640 1 -- 172.21.15.83:0/1616795291 <== mgr.14118 v2:172.21.15.83:6800/1883694223 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc7b0108470 con 0x7fc798039cf0 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc798039cf0 msgr2=0x7fc79803c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc798039cf0 0x7fc79803c0e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40098c0 tx=0x7fc7a4006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 msgr2=0x7fc7b019b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b019b520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0032e10 tx=0x7fc7a0032e40 comp rx=0 tx=0).stop 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 shutdown_connections 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc798039cf0 0x7fc79803c0e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 --2- 172.21.15.83:0/1616795291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7b0108010 0x7fc7b019b520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 >> 172.21.15.83:0/1616795291 conn(0x7fc7b0101c70 msgr2=0x7fc7b0102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 shutdown_connections 2024-09-19T08:53:21.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.440+0000 7fc7b4a65640 1 -- 172.21.15.83:0/1616795291 wait complete. 2024-09-19T08:53:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:mgr epoch 5 is available 2024-09-19T08:53:21.013 INFO:teuthology.orchestra.run.smithi083.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:53:21.569 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:21 smithi083 ceph-mon[30926]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:53:21.570 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:21 smithi083 ceph-mon[30926]: mgrmap e7: x(active, since 1.00525s) 2024-09-19T08:53:21.570 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:21 smithi083 ceph-mon[30926]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:53:21.570 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:21 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:20] ENGINE Bus STARTING 2024-09-19T08:53:21.570 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:21 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:22.193 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.372+0000 7f6403153640 1 Processor -- start 2024-09-19T08:53:22.193 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6403153640 1 -- start start 2024-09-19T08:53:22.193 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6403153640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc10a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6403153640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc075900 con 0x7f63fc1080a0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6400eef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc10a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6400eef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc10a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42160/0 (socket says 172.21.15.83:42160) 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6400eef640 1 -- 172.21.15.83:0/475834728 learned_addr learned my addr 172.21.15.83:0/475834728 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.373+0000 7f6400eef640 1 -- 172.21.15.83:0/475834728 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc10a9d0 con 0x7f63fc1080a0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.374+0000 7f6400eef640 1 --2- 172.21.15.83:0/475834728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc10a490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009820 tx=0x7f63f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e67b487bb92754 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.374+0000 7f63fb7fe640 1 -- 172.21.15.83:0/475834728 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f0037070 con 0x7f63fc1080a0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.374+0000 7f63fb7fe640 1 -- 172.21.15.83:0/475834728 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f63f00328d0 con 0x7f63fc1080a0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.374+0000 7f63fb7fe640 1 -- 172.21.15.83:0/475834728 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f00307d0 con 0x7f63fc1080a0 2024-09-19T08:53:22.196 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- 172.21.15.83:0/475834728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 msgr2=0x7f63fc10a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 --2- 172.21.15.83:0/475834728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc10a490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009820 tx=0x7f63f002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:22.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- 172.21.15.83:0/475834728 shutdown_connections 2024-09-19T08:53:22.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 --2- 172.21.15.83:0/475834728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc10a490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- 172.21.15.83:0/475834728 >> 172.21.15.83:0/475834728 conn(0x7f63fc101cc0 msgr2=0x7f63fc1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- 172.21.15.83:0/475834728 shutdown_connections 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- 172.21.15.83:0/475834728 wait complete. 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 Processor -- start 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- start start 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6403153640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc10b950 con 0x7f63fc1080a0 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6400eef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6400eef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42172/0 (socket says 172.21.15.83:42172) 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.375+0000 7f6400eef640 1 -- 172.21.15.83:0/443285036 learned_addr learned my addr 172.21.15.83:0/443285036 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f6400eef640 1 -- 172.21.15.83:0/443285036 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc19ba60 con 0x7f63fc1080a0 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f6400eef640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc19b520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63f00097f0 tx=0x7f63f0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f0037040 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc19bcf0 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f63f0032bb0 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f003a390 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.376+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc19e9e0 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.377+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f63f003b3f0 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.377+0000 7f63f9ffb640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f63ec0390a0 0x7f63ec03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.377+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f63f006c370 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.377+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc108500 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.377+0000 7f63fbfff640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f63ec0390a0 0x7f63ec03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.378+0000 7f63fbfff640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f63ec0390a0 0x7f63ec03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63e80098c0 tx=0x7f63e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.382+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63f0032d60 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.436+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f63f003a5d0 con 0x7f63fc1080a0 2024-09-19T08:53:22.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.568+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f63fc102f80 con 0x7f63ec0390a0 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.573+0000 7f63f9ffb640 1 -- 172.21.15.83:0/443285036 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63fc102f80 con 0x7f63ec0390a0 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f63ec0390a0 msgr2=0x7f63ec03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f63ec0390a0 0x7f63ec03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63e80098c0 tx=0x7f63e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 msgr2=0x7f63fc19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc19b520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63f00097f0 tx=0x7f63f0030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 shutdown_connections 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f63ec0390a0 0x7f63ec03b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 --2- 172.21.15.83:0/443285036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63fc1080a0 0x7f63fc19b520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 >> 172.21.15.83:0/443285036 conn(0x7f63fc101cc0 msgr2=0x7f63fc102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 shutdown_connections 2024-09-19T08:53:22.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:21.576+0000 7f6403153640 1 -- 172.21.15.83:0/443285036 wait complete. 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:20] ENGINE Serving on http://172.21.15.83:8765 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:20] ENGINE Serving on https://172.21.15.83:7150 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:20] ENGINE Bus STARTED 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:20] ENGINE Error in HTTPServer.serve 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout: Traceback (most recent call last): 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._run(expiration_interval) 2024-09-19T08:53:22.455 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: s = self.context.wrap_socket( 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: return self.sslsocket_class._create( 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: self.do_handshake() 2024-09-19T08:53:22.456 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:53:22.457 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._sslobj.do_handshake() 2024-09-19T08:53:22.457 INFO:journalctl@ceph.mon.a.smithi083.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:53:22.457 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: mgrmap e8: x(active, since 2s) 2024-09-19T08:53:22.457 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:22.457 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:22.457 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:22 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.604+0000 7f561284c640 1 Processor -- start 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.604+0000 7f561284c640 1 -- start start 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.604+0000 7f561284c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c10a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.604+0000 7f561284c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f560c0758c0 con 0x7f560c108090 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.605+0000 7f560bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c10a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.605+0000 7f560bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c10a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42186/0 (socket says 172.21.15.83:42186) 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.605+0000 7f560bfff640 1 -- 172.21.15.83:0/1064748435 learned_addr learned my addr 172.21.15.83:0/1064748435 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.605+0000 7f560bfff640 1 -- 172.21.15.83:0/1064748435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c10a9c0 con 0x7f560c108090 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f560bfff640 1 --2- 172.21.15.83:0/1064748435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c10a480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009820 tx=0x7f55fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc78a670b80ebe2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.390 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f560b7fe640 1 -- 172.21.15.83:0/1064748435 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc037070 con 0x7f560c108090 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f560b7fe640 1 -- 172.21.15.83:0/1064748435 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f55fc0328d0 con 0x7f560c108090 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f560b7fe640 1 -- 172.21.15.83:0/1064748435 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc0307d0 con 0x7f560c108090 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 -- 172.21.15.83:0/1064748435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 msgr2=0x7f560c10a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 --2- 172.21.15.83:0/1064748435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c10a480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009820 tx=0x7f55fc02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 -- 172.21.15.83:0/1064748435 shutdown_connections 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 --2- 172.21.15.83:0/1064748435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c10a480 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 -- 172.21.15.83:0/1064748435 >> 172.21.15.83:0/1064748435 conn(0x7f560c101c70 msgr2=0x7f560c104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 -- 172.21.15.83:0/1064748435 shutdown_connections 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.606+0000 7f561284c640 1 -- 172.21.15.83:0/1064748435 wait complete. 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f561284c640 1 Processor -- start 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f561284c640 1 -- start start 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f561284c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f561284c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f560c10b940 con 0x7f560c108090 2024-09-19T08:53:23.391 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f560bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f560bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42202/0 (socket says 172.21.15.83:42202) 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f560bfff640 1 -- 172.21.15.83:0/1088357133 learned_addr learned my addr 172.21.15.83:0/1088357133 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.607+0000 7f560bfff640 1 -- 172.21.15.83:0/1088357133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c19ba80 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.608+0000 7f560bfff640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c19b540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55fc032e10 tx=0x7f55fc032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.608+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc042070 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.608+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f55fc030c80 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.608+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc037040 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.608+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c19bd10 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.608+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c19ea00 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.609+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f55fc045070 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.609+0000 7f5609ffb640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f55f8039200 0x7f55f803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.609+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560c1084f0 con 0x7f560c108090 2024-09-19T08:53:23.392 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.609+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f55fc06c180 con 0x7f560c108090 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.610+0000 7f5603fff640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f55f8039200 0x7f55f803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.610+0000 7f5603fff640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f55f8039200 0x7f55f803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098c0 tx=0x7f55f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.614+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55fc045360 con 0x7f560c108090 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.782+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f560c102f80 con 0x7f55f8039200 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.783+0000 7f5609ffb640 1 -- 172.21.15.83:0/1088357133 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f560c102f80 con 0x7f55f8039200 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f55f8039200 msgr2=0x7f55f803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f55f8039200 0x7f55f803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098c0 tx=0x7f55f4006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 msgr2=0x7f560c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c19b540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55fc032e10 tx=0x7f55fc032e40 comp rx=0 tx=0).stop 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 shutdown_connections 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f55f8039200 0x7f55f803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.393 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 --2- 172.21.15.83:0/1088357133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f560c108090 0x7f560c19b540 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.394 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 >> 172.21.15.83:0/1088357133 conn(0x7f560c101c70 msgr2=0x7f560c102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.394 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 shutdown_connections 2024-09-19T08:53:23.394 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:22.785+0000 7f561284c640 1 -- 172.21.15.83:0/1088357133 wait complete. 2024-09-19T08:53:23.394 INFO:teuthology.orchestra.run.smithi083.stdout:Generating ssh key... 2024-09-19T08:53:23.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:23 smithi083 ceph-mon[30926]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:24.711 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: Generating public/private rsa key pair. 2024-09-19T08:53:24.711 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: Your identification has been saved in /tmp/tmpn9rlw1kr/key 2024-09-19T08:53:24.711 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: Your public key has been saved in /tmp/tmpn9rlw1kr/key.pub 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: The key fingerprint is: 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: SHA256:zMeixZ7ERoLfmVqBW4UbkefGXo4GmACZvaCxP7Yt4Dw ceph-68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: The key's randomart image is: 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: +---[RSA 3072]----+ 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: | .= .+. | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: |. + o. .+.. | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: | + ..ooo+* | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: |o ..o@o=+ . | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: | . o S+o+ | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: |. + O ++ . | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: |oo + o o. | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: | Eo . | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: | .. | 2024-09-19T08:53:24.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: +----[SHA256]-----+ 2024-09-19T08:53:25.029 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5ddb38640 1 Processor -- start 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5ddb38640 1 -- start start 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5ddb38640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d8106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5ddb38640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d8106e20 con 0x7fc5d8106450 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d8106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d8106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42206/0 (socket says 172.21.15.83:42206) 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5d77fe640 1 -- 172.21.15.83:0/627831150 learned_addr learned my addr 172.21.15.83:0/627831150 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.862+0000 7fc5d77fe640 1 -- 172.21.15.83:0/627831150 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d8107650 con 0x7fc5d8106450 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5d77fe640 1 --2- 172.21.15.83:0/627831150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d8106850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009820 tx=0x7fc5c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9151d2f4e09cba6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5d6ffd640 1 -- 172.21.15.83:0/627831150 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c8037070 con 0x7fc5d8106450 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5d6ffd640 1 -- 172.21.15.83:0/627831150 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc5c80328d0 con 0x7fc5d8106450 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5d6ffd640 1 -- 172.21.15.83:0/627831150 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c80307d0 con 0x7fc5d8106450 2024-09-19T08:53:25.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5ddb38640 1 -- 172.21.15.83:0/627831150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 msgr2=0x7fc5d8106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5ddb38640 1 --2- 172.21.15.83:0/627831150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d8106850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009820 tx=0x7fc5c802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.863+0000 7fc5ddb38640 1 -- 172.21.15.83:0/627831150 shutdown_connections 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.864+0000 7fc5ddb38640 1 --2- 172.21.15.83:0/627831150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d8106850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.864+0000 7fc5ddb38640 1 -- 172.21.15.83:0/627831150 >> 172.21.15.83:0/627831150 conn(0x7fc5d8101c60 msgr2=0x7fc5d8104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.864+0000 7fc5ddb38640 1 -- 172.21.15.83:0/627831150 shutdown_connections 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.864+0000 7fc5ddb38640 1 -- 172.21.15.83:0/627831150 wait complete. 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.864+0000 7fc5ddb38640 1 Processor -- start 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.864+0000 7fc5ddb38640 1 -- start start 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5ddb38640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5ddb38640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d810aa00 con 0x7fc5d8106450 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d819a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42218/0 (socket says 172.21.15.83:42218) 2024-09-19T08:53:25.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d77fe640 1 -- 172.21.15.83:0/1720894033 learned_addr learned my addr 172.21.15.83:0/1720894033 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d77fe640 1 -- 172.21.15.83:0/1720894033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d819a960 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d77fe640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d819a420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80097f0 tx=0x7fc5c8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c8037040 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc5c8032bb0 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d819abf0 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c803a390 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.865+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d819d8e0 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.866+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc5c803a580 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.866+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d810ab80 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.866+0000 7fc5d57fa640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc5c4039200 0x7fc5c403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.866+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc5c806c630 con 0x7fc5d8106450 2024-09-19T08:53:25.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.866+0000 7fc5ceffd640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc5c4039200 0x7fc5c403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.867+0000 7fc5ceffd640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc5c4039200 0x7fc5c403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00098c0 tx=0x7fc5c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:23.871+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5c8032dd0 con 0x7fc5d8106450 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.038+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fc5d8102ea0 con 0x7fc5c4039200 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.437+0000 7fc5d57fa640 1 -- 172.21.15.83:0/1720894033 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc5d8102ea0 con 0x7fc5c4039200 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc5c4039200 msgr2=0x7fc5c403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc5c4039200 0x7fc5c403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00098c0 tx=0x7fc5c0006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 msgr2=0x7fc5d819a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d819a420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80097f0 tx=0x7fc5c8030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 shutdown_connections 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc5c4039200 0x7fc5c403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 --2- 172.21.15.83:0/1720894033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d8106450 0x7fc5d819a420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 >> 172.21.15.83:0/1720894033 conn(0x7fc5d8101c60 msgr2=0x7fc5d8102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.439+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 shutdown_connections 2024-09-19T08:53:25.033 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:24.440+0000 7fc5ddb38640 1 -- 172.21.15.83:0/1720894033 wait complete. 2024-09-19T08:53:25.614 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:25 smithi083 ceph-mon[30926]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:25.614 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:25 smithi083 ceph-mon[30926]: Generating ssh key... 2024-09-19T08:53:25.614 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:25 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:25.615 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:25 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.437+0000 7efca0dc4640 1 Processor -- start 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.437+0000 7efca0dc4640 1 -- start start 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.437+0000 7efca0dc4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c10a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.437+0000 7efca0dc4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c075980 con 0x7efc9c107fc0 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.438+0000 7efc9a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c10a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.438+0000 7efc9a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c10a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42222/0 (socket says 172.21.15.83:42222) 2024-09-19T08:53:26.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.438+0000 7efc9a59c640 1 -- 172.21.15.83:0/430541960 learned_addr learned my addr 172.21.15.83:0/430541960 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.438+0000 7efc9a59c640 1 -- 172.21.15.83:0/430541960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c10a8f0 con 0x7efc9c107fc0 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.438+0000 7efc9a59c640 1 --2- 172.21.15.83:0/430541960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c10a3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009820 tx=0x7efc8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b93f85110d88e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efc99d9b640 1 -- 172.21.15.83:0/430541960 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc8c037070 con 0x7efc9c107fc0 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efc99d9b640 1 -- 172.21.15.83:0/430541960 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efc8c0328d0 con 0x7efc9c107fc0 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efc99d9b640 1 -- 172.21.15.83:0/430541960 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc8c0307d0 con 0x7efc9c107fc0 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 -- 172.21.15.83:0/430541960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 msgr2=0x7efc9c10a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 --2- 172.21.15.83:0/430541960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c10a3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009820 tx=0x7efc8c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 -- 172.21.15.83:0/430541960 shutdown_connections 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 --2- 172.21.15.83:0/430541960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c10a3b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 -- 172.21.15.83:0/430541960 >> 172.21.15.83:0/430541960 conn(0x7efc9c101c60 msgr2=0x7efc9c104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 -- 172.21.15.83:0/430541960 shutdown_connections 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.439+0000 7efca0dc4640 1 -- 172.21.15.83:0/430541960 wait complete. 2024-09-19T08:53:26.205 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efca0dc4640 1 Processor -- start 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efca0dc4640 1 -- start start 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efca0dc4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efca0dc4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c10b930 con 0x7efc9c107fc0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efc9a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efc9a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c19b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42236/0 (socket says 172.21.15.83:42236) 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.440+0000 7efc9a59c640 1 -- 172.21.15.83:0/1917854230 learned_addr learned my addr 172.21.15.83:0/1917854230 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efc9a59c640 1 -- 172.21.15.83:0/1917854230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c19ba20 con 0x7efc9c107fc0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efc9a59c640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c19b4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0097f0 tx=0x7efc8c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc8c037040 con 0x7efc9c107fc0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efc8c032bb0 con 0x7efc9c107fc0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc8c03a390 con 0x7efc9c107fc0 2024-09-19T08:53:26.206 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c19bcb0 con 0x7efc9c107fc0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.441+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c19e9a0 con 0x7efc9c107fc0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.442+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7efc8c03a580 con 0x7efc9c107fc0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.442+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c108420 con 0x7efc9c107fc0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.442+0000 7efc93fff640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7efc88039200 0x7efc8803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.442+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efc8c06c4d0 con 0x7efc9c107fc0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.442+0000 7efc91d9b640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7efc88039200 0x7efc8803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.443+0000 7efc91d9b640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7efc88039200 0x7efc8803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc840098c0 tx=0x7efc84006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.447+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc8c032d60 con 0x7efc9c107fc0 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.614+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7efc9c102ed0 con 0x7efc88039200 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.615+0000 7efc93fff640 1 -- 172.21.15.83:0/1917854230 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7efc9c102ed0 con 0x7efc88039200 2024-09-19T08:53:26.207 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.617+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7efc88039200 msgr2=0x7efc8803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.617+0000 7efca0dc4640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7efc88039200 0x7efc8803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc840098c0 tx=0x7efc84006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.617+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 msgr2=0x7efc9c19b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c19b4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0097f0 tx=0x7efc8c030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 shutdown_connections 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7efc88039200 0x7efc8803b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 --2- 172.21.15.83:0/1917854230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9c107fc0 0x7efc9c19b4e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 >> 172.21.15.83:0/1917854230 conn(0x7efc9c101c60 msgr2=0x7efc9c1027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 shutdown_connections 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:25.618+0000 7efca0dc4640 1 -- 172.21.15.83:0/1917854230 wait complete. 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:53:26.208 INFO:teuthology.orchestra.run.smithi083.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:53:26.213 INFO:teuthology.orchestra.run.smithi083.stdout:Adding host smithi083... 2024-09-19T08:53:26.448 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:26 smithi083 ceph-mon[30926]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:27.855 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:27 smithi083 ceph-mon[30926]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi083", "addr": "172.21.15.83", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:28.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:28 smithi083 ceph-mon[30926]: Deploying cephadm binary to smithi083 2024-09-19T08:53:30.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Added host 'smithi083' with addr '172.21.15.83' 2024-09-19T08:53:30.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586cf46640 1 Processor -- start 2024-09-19T08:53:30.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586cf46640 1 -- start start 2024-09-19T08:53:30.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586cf46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586810a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:30.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586cf46640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5868075940 con 0x7f5868108060 2024-09-19T08:53:30.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586810a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586810a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42238/0 (socket says 172.21.15.83:42238) 2024-09-19T08:53:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586659c640 1 -- 172.21.15.83:0/1712326523 learned_addr learned my addr 172.21.15.83:0/1712326523 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.632+0000 7f586659c640 1 -- 172.21.15.83:0/1712326523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586810a990 con 0x7f5868108060 2024-09-19T08:53:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.633+0000 7f586659c640 1 --2- 172.21.15.83:0/1712326523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586810a450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5858009820 tx=0x7f585802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e01b5a1ecfe87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.633+0000 7f5865d9b640 1 -- 172.21.15.83:0/1712326523 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5858037070 con 0x7f5868108060 2024-09-19T08:53:30.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.633+0000 7f5865d9b640 1 -- 172.21.15.83:0/1712326523 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f58580328d0 con 0x7f5868108060 2024-09-19T08:53:30.618 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.633+0000 7f5865d9b640 1 -- 172.21.15.83:0/1712326523 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58580307d0 con 0x7f5868108060 2024-09-19T08:53:30.618 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 -- 172.21.15.83:0/1712326523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 msgr2=0x7f586810a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:30.618 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 --2- 172.21.15.83:0/1712326523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586810a450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5858009820 tx=0x7f585802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:30.618 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 -- 172.21.15.83:0/1712326523 shutdown_connections 2024-09-19T08:53:30.618 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 --2- 172.21.15.83:0/1712326523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586810a450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.619 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 -- 172.21.15.83:0/1712326523 >> 172.21.15.83:0/1712326523 conn(0x7f5868101cc0 msgr2=0x7f58681040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:30.619 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 -- 172.21.15.83:0/1712326523 shutdown_connections 2024-09-19T08:53:30.619 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 -- 172.21.15.83:0/1712326523 wait complete. 2024-09-19T08:53:30.619 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.634+0000 7f586cf46640 1 Processor -- start 2024-09-19T08:53:30.619 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586cf46640 1 -- start start 2024-09-19T08:53:30.619 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586cf46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:30.620 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586cf46640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f586810b970 con 0x7f5868108060 2024-09-19T08:53:30.620 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:30.620 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42248/0 (socket says 172.21.15.83:42248) 2024-09-19T08:53:30.620 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586659c640 1 -- 172.21.15.83:0/302281445 learned_addr learned my addr 172.21.15.83:0/302281445 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:30.620 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586659c640 1 -- 172.21.15.83:0/302281445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586819ba90 con 0x7f5868108060 2024-09-19T08:53:30.620 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.635+0000 7f586659c640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586819b550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58580097f0 tx=0x7f5858030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:30.621 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.636+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5858037040 con 0x7f5868108060 2024-09-19T08:53:30.621 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.636+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5858032bb0 con 0x7f5868108060 2024-09-19T08:53:30.621 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.636+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586819bd20 con 0x7f5868108060 2024-09-19T08:53:30.621 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.636+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585803a390 con 0x7f5868108060 2024-09-19T08:53:30.621 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.636+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586819ea10 con 0x7f5868108060 2024-09-19T08:53:30.621 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.636+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f585803a5d0 con 0x7f5868108060 2024-09-19T08:53:30.622 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.637+0000 7f585ffff640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f58540391b0 0x7f585403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:30.622 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.637+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f585806d4c0 con 0x7f5868108060 2024-09-19T08:53:30.622 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.637+0000 7f585dd9b640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f58540391b0 0x7f585403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:30.622 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.637+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58681084c0 con 0x7f5868108060 2024-09-19T08:53:30.622 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.637+0000 7f585dd9b640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f58540391b0 0x7f585403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58500098c0 tx=0x7f5850006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:30.622 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.642+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5858040210 con 0x7f5868108060 2024-09-19T08:53:30.623 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:26.813+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi083", "addr": "172.21.15.83", "target": ["mon-mgr", ""]}) -- 0x7f5868102f80 con 0x7f58540391b0 2024-09-19T08:53:30.623 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.005+0000 7f585ffff640 1 -- 172.21.15.83:0/302281445 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5868102f80 con 0x7f58540391b0 2024-09-19T08:53:30.623 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f58540391b0 msgr2=0x7f585403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:30.623 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f58540391b0 0x7f585403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58500098c0 tx=0x7f5850006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.623 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 msgr2=0x7f586819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:30.623 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586819b550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58580097f0 tx=0x7f5858030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 shutdown_connections 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f58540391b0 0x7f585403b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 --2- 172.21.15.83:0/302281445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5868108060 0x7f586819b550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 >> 172.21.15.83:0/302281445 conn(0x7f5868101cc0 msgr2=0x7f5868102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 shutdown_connections 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.008+0000 7f586cf46640 1 -- 172.21.15.83:0/302281445 wait complete. 2024-09-19T08:53:30.624 INFO:teuthology.orchestra.run.smithi083.stdout:Deploying unmanaged mon service... 2024-09-19T08:53:31.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:31 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:31.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:31 smithi083 ceph-mon[30926]: Added host smithi083 2024-09-19T08:53:31.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:31 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:31.973 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:53:31.979 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037f048640 1 Processor -- start 2024-09-19T08:53:31.979 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037f048640 1 -- start start 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037f048640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f03781079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037f048640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0378107f80 con 0x7f03781075b0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037cde4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f03781079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037cde4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f03781079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41556/0 (socket says 172.21.15.83:41556) 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.004+0000 7f037cde4640 1 -- 172.21.15.83:0/3635773187 learned_addr learned my addr 172.21.15.83:0/3635773187 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.005+0000 7f037cde4640 1 -- 172.21.15.83:0/3635773187 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03781087b0 con 0x7f03781075b0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.005+0000 7f037cde4640 1 --2- 172.21.15.83:0/3635773187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f03781079b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f036c009820 tx=0x7f036c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a38dfc88ef6a2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.006+0000 7f03777fe640 1 -- 172.21.15.83:0/3635773187 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c037070 con 0x7f03781075b0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.006+0000 7f03777fe640 1 -- 172.21.15.83:0/3635773187 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f036c0328d0 con 0x7f03781075b0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.006+0000 7f03777fe640 1 -- 172.21.15.83:0/3635773187 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0307d0 con 0x7f03781075b0 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 -- 172.21.15.83:0/3635773187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 msgr2=0x7f03781079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 --2- 172.21.15.83:0/3635773187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f03781079b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f036c009820 tx=0x7f036c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:31.980 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 -- 172.21.15.83:0/3635773187 shutdown_connections 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 --2- 172.21.15.83:0/3635773187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f03781079b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 -- 172.21.15.83:0/3635773187 >> 172.21.15.83:0/3635773187 conn(0x7f0378102d00 msgr2=0x7f0378105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 -- 172.21.15.83:0/3635773187 shutdown_connections 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 -- 172.21.15.83:0/3635773187 wait complete. 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 Processor -- start 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.007+0000 7f037f048640 1 -- start start 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037f048640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f0378199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037f048640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f037807afe0 con 0x7f03781075b0 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037cde4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f0378199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037cde4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f0378199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41572/0 (socket says 172.21.15.83:41572) 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037cde4640 1 -- 172.21.15.83:0/647493463 learned_addr learned my addr 172.21.15.83:0/647493463 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:31.981 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037cde4640 1 -- 172.21.15.83:0/647493463 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378199840 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037cde4640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f0378199300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f036c0097f0 tx=0x7f036c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c037040 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f036c032bb0 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0378199ad0 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c03a390 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.008+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037819c7c0 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.009+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f036c03a580 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.009+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0378107a30 con 0x7f03781075b0 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.009+0000 7f0375ffb640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f036803d660 0x7f036803fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:31.982 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.010+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f036c06c430 con 0x7f03781075b0 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.010+0000 7f0377fff640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f036803d660 0x7f036803fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.010+0000 7f0377fff640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f036803d660 0x7f036803fb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f03640098c0 tx=0x7f0364006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.014+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f036c02c000 con 0x7f03781075b0 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.224+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f037802dab0 con 0x7f036803d660 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.229+0000 7f0375ffb640 1 -- 172.21.15.83:0/647493463 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f037802dab0 con 0x7f036803d660 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f036803d660 msgr2=0x7f036803fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f036803d660 0x7f036803fb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f03640098c0 tx=0x7f0364006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 msgr2=0x7f0378199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:31.983 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f0378199300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f036c0097f0 tx=0x7f036c030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 shutdown_connections 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f036803d660 0x7f036803fb20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 --2- 172.21.15.83:0/647493463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03781075b0 0x7f0378199300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 >> 172.21.15.83:0/647493463 conn(0x7f0378102d00 msgr2=0x7f0378103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 shutdown_connections 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.231+0000 7f037f048640 1 -- 172.21.15.83:0/647493463 wait complete. 2024-09-19T08:53:31.984 INFO:teuthology.orchestra.run.smithi083.stdout:Deploying unmanaged mgr service... 2024-09-19T08:53:32.643 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:32 smithi083 ceph-mon[30926]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:32.643 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:32 smithi083 ceph-mon[30926]: Saving service mon spec with placement count:5 2024-09-19T08:53:32.644 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:32 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:33.396 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.465+0000 7f47d29fe640 1 Processor -- start 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.465+0000 7f47d29fe640 1 -- start start 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.466+0000 7f47d29fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc10a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.466+0000 7f47d29fe640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc075980 con 0x7f47cc107fc0 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.466+0000 7f47cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc10a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.466+0000 7f47cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc10a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41588/0 (socket says 172.21.15.83:41588) 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.466+0000 7f47cbfff640 1 -- 172.21.15.83:0/3661711902 learned_addr learned my addr 172.21.15.83:0/3661711902 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.466+0000 7f47cbfff640 1 -- 172.21.15.83:0/3661711902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc10a8f0 con 0x7f47cc107fc0 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.467+0000 7f47cbfff640 1 --2- 172.21.15.83:0/3661711902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc10a3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009820 tx=0x7f47bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e916b5efffb69f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.467+0000 7f47cb7fe640 1 -- 172.21.15.83:0/3661711902 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc037070 con 0x7f47cc107fc0 2024-09-19T08:53:33.397 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.467+0000 7f47cb7fe640 1 -- 172.21.15.83:0/3661711902 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f47bc0328d0 con 0x7f47cc107fc0 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.467+0000 7f47cb7fe640 1 -- 172.21.15.83:0/3661711902 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc0307d0 con 0x7f47cc107fc0 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- 172.21.15.83:0/3661711902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 msgr2=0x7f47cc10a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 --2- 172.21.15.83:0/3661711902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc10a3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009820 tx=0x7f47bc02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- 172.21.15.83:0/3661711902 shutdown_connections 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 --2- 172.21.15.83:0/3661711902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc10a3b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- 172.21.15.83:0/3661711902 >> 172.21.15.83:0/3661711902 conn(0x7f47cc101c60 msgr2=0x7f47cc104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- 172.21.15.83:0/3661711902 shutdown_connections 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- 172.21.15.83:0/3661711902 wait complete. 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 Processor -- start 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- start start 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.468+0000 7f47d29fe640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc10b930 con 0x7f47cc107fc0 2024-09-19T08:53:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc19b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41600/0 (socket says 172.21.15.83:41600) 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47cbfff640 1 -- 172.21.15.83:0/3164696507 learned_addr learned my addr 172.21.15.83:0/3164696507 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47cbfff640 1 -- 172.21.15.83:0/3164696507 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc19ba20 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47cbfff640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc19b4e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097f0 tx=0x7f47bc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc037040 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f47bc032bb0 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc03a390 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc19bcb0 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.469+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc19e9a0 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.470+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f47bc03b3f0 con 0x7f47cc107fc0 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.470+0000 7f47c9ffb640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f47b8039200 0x7f47b803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.470+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc108420 con 0x7f47cc107fc0 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.470+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f47bc06c490 con 0x7f47cc107fc0 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.470+0000 7f47c3fff640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f47b8039200 0x7f47b803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.471+0000 7f47c3fff640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f47b8039200 0x7f47b803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47b40098c0 tx=0x7f47b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.475+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47bc040210 con 0x7f47cc107fc0 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.656+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f47cc102ed0 con 0x7f47b8039200 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.660+0000 7f47c9ffb640 1 -- 172.21.15.83:0/3164696507 <== mgr.14118 v2:172.21.15.83:6800/1883694223 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f47cc102ed0 con 0x7f47b8039200 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f47b8039200 msgr2=0x7f47b803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f47b8039200 0x7f47b803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47b40098c0 tx=0x7f47b4006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 msgr2=0x7f47cc19b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc19b4e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097f0 tx=0x7f47bc030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 shutdown_connections 2024-09-19T08:53:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f47b8039200 0x7f47b803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 --2- 172.21.15.83:0/3164696507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47cc107fc0 0x7f47cc19b4e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.662+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 >> 172.21.15.83:0/3164696507 conn(0x7f47cc101c60 msgr2=0x7f47cc1027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.663+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 shutdown_connections 2024-09-19T08:53:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.663+0000 7f47d29fe640 1 -- 172.21.15.83:0/3164696507 wait complete. 2024-09-19T08:53:33.829 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:33 smithi083 ceph-mon[30926]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:33.829 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:33 smithi083 ceph-mon[30926]: Saving service mgr spec with placement count:2 2024-09-19T08:53:33.829 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:33 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:35.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:35 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/510369215' entity='client.admin' 2024-09-19T08:53:35.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:35 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:35.379 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feb0177f640 1 Processor -- start 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feb0177f640 1 -- start start 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feb0177f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc10a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feb0177f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feafc075920 con 0x7feafc1080a0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feafaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc10a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feafaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc10a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41616/0 (socket says 172.21.15.83:41616) 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.829+0000 7feafaffd640 1 -- 172.21.15.83:0/2575946354 learned_addr learned my addr 172.21.15.83:0/2575946354 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.830+0000 7feafaffd640 1 -- 172.21.15.83:0/2575946354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc10a9d0 con 0x7feafc1080a0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feafaffd640 1 --2- 172.21.15.83:0/2575946354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc10a490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feaec009820 tx=0x7feaec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bc7be031e276fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feafa7fc640 1 -- 172.21.15.83:0/2575946354 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec037070 con 0x7feafc1080a0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feafa7fc640 1 -- 172.21.15.83:0/2575946354 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7feaec0328d0 con 0x7feafc1080a0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feafa7fc640 1 -- 172.21.15.83:0/2575946354 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec0307d0 con 0x7feafc1080a0 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 -- 172.21.15.83:0/2575946354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 msgr2=0x7feafc10a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:35.380 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 --2- 172.21.15.83:0/2575946354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc10a490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feaec009820 tx=0x7feaec02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 -- 172.21.15.83:0/2575946354 shutdown_connections 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 --2- 172.21.15.83:0/2575946354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc10a490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 -- 172.21.15.83:0/2575946354 >> 172.21.15.83:0/2575946354 conn(0x7feafc101cc0 msgr2=0x7feafc1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 -- 172.21.15.83:0/2575946354 shutdown_connections 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.831+0000 7feb0177f640 1 -- 172.21.15.83:0/2575946354 wait complete. 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feb0177f640 1 Processor -- start 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feb0177f640 1 -- start start 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feb0177f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feb0177f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feafc10b9b0 con 0x7feafc1080a0 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feafaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feafaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc19b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41618/0 (socket says 172.21.15.83:41618) 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.832+0000 7feafaffd640 1 -- 172.21.15.83:0/510369215 learned_addr learned my addr 172.21.15.83:0/510369215 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:35.381 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feafaffd640 1 -- 172.21.15.83:0/510369215 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc19bad0 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feafaffd640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc19b590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feaec0097f0 tx=0x7feaec030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec037040 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7feaec03b3f0 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc19bd60 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec03a520 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.833+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc19ea50 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.834+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7feaec03a710 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.834+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc108500 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.834+0000 7feaf8ff9640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7feae80391b0 0x7feae803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.834+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feaec06c530 con 0x7feafc1080a0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.834+0000 7feaf27fc640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7feae80391b0 0x7feae803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.835+0000 7feaf27fc640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7feae80391b0 0x7feae803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feae40098c0 tx=0x7feae4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:35.382 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.839+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feaec03b980 con 0x7feafc1080a0 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.003+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7feafc19f0d0 con 0x7feafc1080a0 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.005+0000 7feaf8ff9640 1 -- 172.21.15.83:0/510369215 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7feaec032820 con 0x7feafc1080a0 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7feae80391b0 msgr2=0x7feae803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7feae80391b0 0x7feae803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feae40098c0 tx=0x7feae4006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 msgr2=0x7feafc19b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc19b590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feaec0097f0 tx=0x7feaec030d00 comp rx=0 tx=0).stop 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 shutdown_connections 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7feae80391b0 0x7feae803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 --2- 172.21.15.83:0/510369215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feafc1080a0 0x7feafc19b590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 >> 172.21.15.83:0/510369215 conn(0x7feafc101cc0 msgr2=0x7feafc1028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 shutdown_connections 2024-09-19T08:53:35.383 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.008+0000 7feb0177f640 1 -- 172.21.15.83:0/510369215 wait complete. 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb747b6640 1 Processor -- start 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb747b6640 1 -- start start 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb747b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c10a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb747b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c075980 con 0x7ffb6c108020 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb72552640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c10a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb72552640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c10a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41626/0 (socket says 172.21.15.83:41626) 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb72552640 1 -- 172.21.15.83:0/3422500384 learned_addr learned my addr 172.21.15.83:0/3422500384 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.792+0000 7ffb72552640 1 -- 172.21.15.83:0/3422500384 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c10a950 con 0x7ffb6c108020 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.793+0000 7ffb72552640 1 --2- 172.21.15.83:0/3422500384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c10a410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009820 tx=0x7ffb5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ad8b633a7e9141 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.793+0000 7ffb71550640 1 -- 172.21.15.83:0/3422500384 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c037070 con 0x7ffb6c108020 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.793+0000 7ffb71550640 1 -- 172.21.15.83:0/3422500384 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb5c0328f0 con 0x7ffb6c108020 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.793+0000 7ffb71550640 1 -- 172.21.15.83:0/3422500384 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c030740 con 0x7ffb6c108020 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 -- 172.21.15.83:0/3422500384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 msgr2=0x7ffb6c10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 --2- 172.21.15.83:0/3422500384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c10a410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009820 tx=0x7ffb5c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 -- 172.21.15.83:0/3422500384 shutdown_connections 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 --2- 172.21.15.83:0/3422500384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c10a410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 -- 172.21.15.83:0/3422500384 >> 172.21.15.83:0/3422500384 conn(0x7ffb6c101cc0 msgr2=0x7ffb6c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 -- 172.21.15.83:0/3422500384 shutdown_connections 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 -- 172.21.15.83:0/3422500384 wait complete. 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.794+0000 7ffb747b6640 1 Processor -- start 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb747b6640 1 -- start start 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb747b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb747b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c10b9d0 con 0x7ffb6c108020 2024-09-19T08:53:36.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb72552640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb72552640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c19b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41638/0 (socket says 172.21.15.83:41638) 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb72552640 1 -- 172.21.15.83:0/2358214029 learned_addr learned my addr 172.21.15.83:0/2358214029 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb72552640 1 -- 172.21.15.83:0/2358214029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c19baa0 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb72552640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c19b560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0097f0 tx=0x7ffb5c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c042070 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb5c030d80 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c19bd30 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c037040 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.795+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c19ea20 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.796+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ffb5c045070 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.796+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb500052c0 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.797+0000 7ffb637fe640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7ffb580391b0 0x7ffb5803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.797+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffb5c06c310 con 0x7ffb6c108020 2024-09-19T08:53:36.575 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.797+0000 7ffb71d51640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7ffb580391b0 0x7ffb5803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.797+0000 7ffb71d51640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7ffb580391b0 0x7ffb5803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb680098c0 tx=0x7ffb68006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.801+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb5c045520 con 0x7ffb6c108020 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.980+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7ffb500055b0 con 0x7ffb6c108020 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.983+0000 7ffb637fe640 1 -- 172.21.15.83:0/2358214029 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7ffb5c03add0 con 0x7ffb6c108020 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7ffb580391b0 msgr2=0x7ffb5803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7ffb580391b0 0x7ffb5803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb680098c0 tx=0x7ffb68006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 msgr2=0x7ffb6c19b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c19b560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0097f0 tx=0x7ffb5c030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 shutdown_connections 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7ffb580391b0 0x7ffb5803b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 --2- 172.21.15.83:0/2358214029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c108020 0x7ffb6c19b560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:36.576 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.985+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 >> 172.21.15.83:0/2358214029 conn(0x7ffb6c101cc0 msgr2=0x7ffb6c102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:36.577 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.986+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 shutdown_connections 2024-09-19T08:53:36.577 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.986+0000 7ffb747b6640 1 -- 172.21.15.83:0/2358214029 wait complete. 2024-09-19T08:53:36.577 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling the dashboard module... 2024-09-19T08:53:37.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:36 smithi083 ceph-mon[30926]: from='mgr.14118 172.21.15.83:0/2649730430' entity='mgr.x' 2024-09-19T08:53:37.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:36 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2358214029' entity='client.admin' 2024-09-19T08:53:38.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:37 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3644315079' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:53:38.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:37 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ignoring --setuser ceph since I am not root 2024-09-19T08:53:38.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:37 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ignoring --setgroup ceph since I am not root 2024-09-19T08:53:38.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.058+0000 7f5f0f831040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:53:38.212 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.115+0000 7f5f0f831040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:53:38.526 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.268+0000 7f5f0f831040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:53:38.526 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.334+0000 7f5f0f831040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:53:38.527 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.482+0000 7f5f0f831040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:53:38.533 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc230a91640 1 Processor -- start 2024-09-19T08:53:38.533 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc230a91640 1 -- start start 2024-09-19T08:53:38.533 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc230a91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c106230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc230a91640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c075900 con 0x7fc22c105e30 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc22a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc22a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41640/0 (socket says 172.21.15.83:41640) 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.064+0000 7fc22a59c640 1 -- 172.21.15.83:0/1474320698 learned_addr learned my addr 172.21.15.83:0/1474320698 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.065+0000 7fc22a59c640 1 -- 172.21.15.83:0/1474320698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c106770 con 0x7fc22c105e30 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.065+0000 7fc22a59c640 1 --2- 172.21.15.83:0/1474320698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c106230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009820 tx=0x7fc21c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fc935fe26f754e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.065+0000 7fc229d9b640 1 -- 172.21.15.83:0/1474320698 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c037070 con 0x7fc22c105e30 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc229d9b640 1 -- 172.21.15.83:0/1474320698 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc21c0328f0 con 0x7fc22c105e30 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc229d9b640 1 -- 172.21.15.83:0/1474320698 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c030740 con 0x7fc22c105e30 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 -- 172.21.15.83:0/1474320698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 msgr2=0x7fc22c106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 --2- 172.21.15.83:0/1474320698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c106230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009820 tx=0x7fc21c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:38.534 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 -- 172.21.15.83:0/1474320698 shutdown_connections 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 --2- 172.21.15.83:0/1474320698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c106230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 -- 172.21.15.83:0/1474320698 >> 172.21.15.83:0/1474320698 conn(0x7fc22c101c60 msgr2=0x7fc22c104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 -- 172.21.15.83:0/1474320698 shutdown_connections 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.066+0000 7fc230a91640 1 -- 172.21.15.83:0/1474320698 wait complete. 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc230a91640 1 Processor -- start 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc230a91640 1 -- start start 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc230a91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc230a91640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c107850 con 0x7fc22c105e30 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc22a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc22a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41644/0 (socket says 172.21.15.83:41644) 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc22a59c640 1 -- 172.21.15.83:0/3644315079 learned_addr learned my addr 172.21.15.83:0/3644315079 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.067+0000 7fc22a59c640 1 -- 172.21.15.83:0/3644315079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c19dc30 con 0x7fc22c105e30 2024-09-19T08:53:38.535 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.068+0000 7fc22a59c640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c19d6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0097f0 tx=0x7fc21c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.068+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c042070 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.068+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc21c030d80 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.068+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c19dec0 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.068+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c037040 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.068+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c1a0bb0 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.069+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc21c045070 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.069+0000 7fc223fff640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc2180391b0 0x7fc21803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.069+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc21c06d220 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.069+0000 7fc221d9b640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc2180391b0 0x7fc21803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.069+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c106230 con 0x7fc22c105e30 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.069+0000 7fc221d9b640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc2180391b0 0x7fc21803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc2140098c0 tx=0x7fc214006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:38.536 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.074+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc21c045360 con 0x7fc22c105e30 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.313+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc22c196b60 con 0x7fc22c105e30 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.909+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc21c03ad80 con 0x7fc22c105e30 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.910+0000 7fc223fff640 1 -- 172.21.15.83:0/3644315079 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fc21c03cc50 con 0x7fc22c105e30 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc2180391b0 msgr2=0x7fc21803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc2180391b0 0x7fc21803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc2140098c0 tx=0x7fc214006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 msgr2=0x7fc22c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c19d6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0097f0 tx=0x7fc21c030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 shutdown_connections 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fc2180391b0 0x7fc21803b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 --2- 172.21.15.83:0/3644315079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc22c105e30 0x7fc22c19d6f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 >> 172.21.15.83:0/3644315079 conn(0x7fc22c101c60 msgr2=0x7fc22c191b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 shutdown_connections 2024-09-19T08:53:38.537 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:37.912+0000 7fc230a91640 1 -- 172.21.15.83:0/3644315079 wait complete. 2024-09-19T08:53:38.781 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.628+0000 7f5f0f831040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:53:39.165 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3644315079' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:53:39.165 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-mon[30926]: mgrmap e9: x(active, since 18s) 2024-09-19T08:53:39.165 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:38 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:38.953+0000 7f5f0f831040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:53:39.165 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:39 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:39.018+0000 7f5f0f831040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:53:39.461 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:39 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:39.210+0000 7f5f0f831040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb67e949640 1 Processor -- start 2024-09-19T08:53:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb67e949640 1 -- start start 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb67e949640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67810a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb67e949640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb678075940 con 0x7fb678108080 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb677fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67810a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb677fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67810a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41664/0 (socket says 172.21.15.83:41664) 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.959+0000 7fb677fff640 1 -- 172.21.15.83:0/3149421484 learned_addr learned my addr 172.21.15.83:0/3149421484 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.960+0000 7fb677fff640 1 -- 172.21.15.83:0/3149421484 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67810a9b0 con 0x7fb678108080 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.960+0000 7fb677fff640 1 --2- 172.21.15.83:0/3149421484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67810a470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb668009820 tx=0x7fb66802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4a611eb336c3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.960+0000 7fb676ffd640 1 -- 172.21.15.83:0/3149421484 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668037070 con 0x7fb678108080 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.960+0000 7fb676ffd640 1 -- 172.21.15.83:0/3149421484 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6680328f0 con 0x7fb678108080 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.960+0000 7fb676ffd640 1 -- 172.21.15.83:0/3149421484 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668030740 con 0x7fb678108080 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 -- 172.21.15.83:0/3149421484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 msgr2=0x7fb67810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 --2- 172.21.15.83:0/3149421484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67810a470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb668009820 tx=0x7fb66802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:39.776 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 -- 172.21.15.83:0/3149421484 shutdown_connections 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 --2- 172.21.15.83:0/3149421484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67810a470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 -- 172.21.15.83:0/3149421484 >> 172.21.15.83:0/3149421484 conn(0x7fb678101cc0 msgr2=0x7fb6781040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 -- 172.21.15.83:0/3149421484 shutdown_connections 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.961+0000 7fb67e949640 1 -- 172.21.15.83:0/3149421484 wait complete. 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb67e949640 1 Processor -- start 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb67e949640 1 -- start start 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb67e949640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb67e949640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810b9d0 con 0x7fb678108080 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb677fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb677fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67819d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41666/0 (socket says 172.21.15.83:41666) 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb677fff640 1 -- 172.21.15.83:0/1791261510 learned_addr learned my addr 172.21.15.83:0/1791261510 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.962+0000 7fb677fff640 1 -- 172.21.15.83:0/1791261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67819dc70 con 0x7fb678108080 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.963+0000 7fb677fff640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67819d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097f0 tx=0x7fb668030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.777 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.963+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668042070 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.963+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb668030d80 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.963+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67819df00 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.963+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668037040 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.963+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781a0bf0 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.964+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fb668045070 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.964+0000 7fb6757fa640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 0x7fb66003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.964+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb66806c360 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.964+0000 7fb6777fe640 1 -- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 msgr2=0x7fb66003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1883694223 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.964+0000 7fb6777fe640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 0x7fb66003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.964+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6781084e0 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.969+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb668045520 con 0x7fb678108080 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.165+0000 7fb6777fe640 1 -- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 msgr2=0x7fb66003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1883694223 2024-09-19T08:53:39.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.165+0000 7fb6777fe640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 0x7fb66003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.188+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb6781a10d0 con 0x7fb678108080 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.189+0000 7fb6757fa640 1 -- 172.21.15.83:0/1791261510 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fb66803add0 con 0x7fb678108080 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 msgr2=0x7fb66003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 0x7fb66003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 msgr2=0x7fb67819d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67819d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097f0 tx=0x7fb668030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 shutdown_connections 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7fb660039260 0x7fb66003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 --2- 172.21.15.83:0/1791261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb678108080 0x7fb67819d730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 >> 172.21.15.83:0/1791261510 conn(0x7fb678101cc0 msgr2=0x7fb678102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 shutdown_connections 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.191+0000 7fb67e949640 1 -- 172.21.15.83:0/1791261510 wait complete. 2024-09-19T08:53:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for the mgr to restart... 2024-09-19T08:53:39.780 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr epoch 9... 2024-09-19T08:53:39.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:39 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1791261510' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:53:40.430 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:40 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:40.119+0000 7f5f0f831040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:53:40.430 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:40 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:40.189+0000 7f5f0f831040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:53:41.158 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:40 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:40.904+0000 7f5f0f831040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:53:41.158 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.018+0000 7f5f0f831040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:53:41.427 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.158+0000 7f5f0f831040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:53:41.427 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.224+0000 7f5f0f831040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:53:41.427 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.379+0000 7f5f0f831040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:53:41.680 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.451+0000 7f5f0f831040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:53:41.680 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.513+0000 7f5f0f831040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:53:41.680 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.680+0000 7f5f0f831040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:53:41.961 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.748+0000 7f5f0f831040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:53:41.961 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.817+0000 7f5f0f831040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:53:41.961 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.903+0000 7f5f0f831040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:53:42.412 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:41 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:41.964+0000 7f5f0f831040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:53:42.412 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:42.025+0000 7f5f0f831040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:53:43.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:42.829+0000 7f5f0f831040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:53:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: Active manager daemon x restarted 2024-09-19T08:53:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: Activating manager daemon x 2024-09-19T08:53:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:53:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: mgrmap e10: x(active, starting, since 0.00349388s) 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: Manager daemon x is now available 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:53:43.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:53:44.402 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:43.993+0000 7f5e752fa640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:53:43] ENGINE Error in HTTPServer.serve 2024-09-19T08:53:44.402 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: Traceback (most recent call last): 2024-09-19T08:53:44.402 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._connections.run(self.expiration_interval) 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._run(expiration_interval) 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: s = self.context.wrap_socket( 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: return self.sslsocket_class._create( 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:53:44.403 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self.do_handshake() 2024-09-19T08:53:44.404 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:53:44.404 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._sslobj.do_handshake() 2024-09-19T08:53:44.404 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:53:44.404 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 08:53:43 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.223+0000 7f711daf0640 1 Processor -- start 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.223+0000 7f711daf0640 1 -- start start 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.224+0000 7f711daf0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f7118106220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.224+0000 7f711daf0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7118075920 con 0x7f7118105e20 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.224+0000 7f71177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f7118106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:44.713 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.224+0000 7f71177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f7118106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38206/0 (socket says 172.21.15.83:38206) 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.224+0000 7f71177fe640 1 -- 172.21.15.83:0/262122284 learned_addr learned my addr 172.21.15.83:0/262122284 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.224+0000 7f71177fe640 1 -- 172.21.15.83:0/262122284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7118106760 con 0x7f7118105e20 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.225+0000 7f71177fe640 1 --2- 172.21.15.83:0/262122284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f7118106220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7108009820 tx=0x7f710802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816d98f4fef5e620 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.225+0000 7f71167fc640 1 -- 172.21.15.83:0/262122284 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7108037070 con 0x7f7118105e20 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.225+0000 7f71167fc640 1 -- 172.21.15.83:0/262122284 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71080328f0 con 0x7f7118105e20 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.225+0000 7f71167fc640 1 -- 172.21.15.83:0/262122284 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7108030740 con 0x7f7118105e20 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 -- 172.21.15.83:0/262122284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 msgr2=0x7f7118106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 --2- 172.21.15.83:0/262122284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f7118106220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7108009820 tx=0x7f710802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 -- 172.21.15.83:0/262122284 shutdown_connections 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 --2- 172.21.15.83:0/262122284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f7118106220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 -- 172.21.15.83:0/262122284 >> 172.21.15.83:0/262122284 conn(0x7f7118101c70 msgr2=0x7f7118104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:44.714 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 -- 172.21.15.83:0/262122284 shutdown_connections 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 -- 172.21.15.83:0/262122284 wait complete. 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.226+0000 7f711daf0640 1 Processor -- start 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f711daf0640 1 -- start start 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f711daf0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f711819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f711daf0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7118107840 con 0x7f7118105e20 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f71177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f711819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f71177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f711819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38216/0 (socket says 172.21.15.83:38216) 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f71177fe640 1 -- 172.21.15.83:0/596664369 learned_addr learned my addr 172.21.15.83:0/596664369 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f71177fe640 1 -- 172.21.15.83:0/596664369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711819dc60 con 0x7f7118105e20 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.227+0000 7f71177fe640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f711819d720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7108030cc0 tx=0x7f7108030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.228+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7108042070 con 0x7f7118105e20 2024-09-19T08:53:44.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.228+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711819def0 con 0x7f7118105e20 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.228+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7108030e60 con 0x7f7118105e20 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.228+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7108037040 con 0x7f7118105e20 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.228+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71181a0be0 con 0x7f7118105e20 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.229+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f7108045070 con 0x7f7118105e20 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.229+0000 7f7114ff9640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.229+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 --> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f710003bdd0 con 0x7f7100039200 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.229+0000 7f7116ffd640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 msgr2=0x7f710003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1883694223 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.229+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f710806c3e0 con 0x7f7118105e20 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.229+0000 7f7116ffd640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.430+0000 7f7116ffd640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 msgr2=0x7f710003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1883694223 2024-09-19T08:53:44.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.430+0000 7f7116ffd640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.831+0000 7f7116ffd640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 msgr2=0x7f710003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1883694223 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.831+0000 7f7116ffd640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.632+0000 7f7116ffd640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 msgr2=0x7f710003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1883694223 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.632+0000 7f7116ffd640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.833+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f710806ae90 con 0x7f7118105e20 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.833+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 msgr2=0x7f710003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.833+0000 7f7114ff9640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.834+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f7108042d00 con 0x7f7118105e20 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.834+0000 7f7114ff9640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f710003ccc0 0x7f710003f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.835+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f710803ee50 con 0x7f710003ccc0 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.835+0000 7f7116ffd640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f710003ccc0 0x7f710003f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.835+0000 7f7116ffd640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f710003ccc0 0x7f710003f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f710c003980 tx=0x7f710c006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:44.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.836+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f710803ee50 con 0x7f710003ccc0 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.842+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7118106220 con 0x7f710003ccc0 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f7114ff9640 1 -- 172.21.15.83:0/596664369 <== mgr.14150 v2:172.21.15.83:6800/2542755280 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f7118106220 con 0x7f710003ccc0 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f710003ccc0 msgr2=0x7f710003f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f710003ccc0 0x7f710003f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f710c003980 tx=0x7f710c006e10 comp rx=0 tx=0).stop 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 msgr2=0x7f711819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f711819d720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7108030cc0 tx=0x7f7108030cf0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 shutdown_connections 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f710003ccc0 0x7f710003f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:6800/1883694223,v1:172.21.15.83:6801/1883694223] conn(0x7f7100039200 0x7f710003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 --2- 172.21.15.83:0/596664369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7118105e20 0x7f711819d720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 >> 172.21.15.83:0/596664369 conn(0x7f7118101c70 msgr2=0x7f7118191a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:44.719 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 shutdown_connections 2024-09-19T08:53:44.719 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:43.843+0000 7f711daf0640 1 -- 172.21.15.83:0/596664369 wait complete. 2024-09-19T08:53:44.719 INFO:teuthology.orchestra.run.smithi083.stdout:mgr epoch 9 is available 2024-09-19T08:53:44.719 INFO:teuthology.orchestra.run.smithi083.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:53:44.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:44 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:43] ENGINE Bus STARTING 2024-09-19T08:53:44.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:44 smithi083 ceph-mon[30926]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:53:44.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:44 smithi083 ceph-mon[30926]: mgrmap e11: x(active, since 1.00578s) 2024-09-19T08:53:44.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:44 smithi083 ceph-mon[30926]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:53:44.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:44 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:43] ENGINE Serving on http://172.21.15.83:8765 2024-09-19T08:53:44.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15bdb17640 1 Processor -- start 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15bdb17640 1 -- start start 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15bdb17640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8106040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15bdb17640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f15b8106610 con 0x7f15b8105c40 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8106040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.966 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8106040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38280/0 (socket says 172.21.15.83:38280) 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15b77fe640 1 -- 172.21.15.83:0/3286031327 learned_addr learned my addr 172.21.15.83:0/3286031327 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.170+0000 7f15b77fe640 1 -- 172.21.15.83:0/3286031327 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b8106e40 con 0x7f15b8105c40 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.171+0000 7f15b77fe640 1 --2- 172.21.15.83:0/3286031327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8106040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009820 tx=0x7f15a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24afeec0a20b839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.171+0000 7f15b67fc640 1 -- 172.21.15.83:0/3286031327 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8037070 con 0x7f15b8105c40 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.171+0000 7f15b67fc640 1 -- 172.21.15.83:0/3286031327 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15a80328f0 con 0x7f15b8105c40 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.171+0000 7f15b67fc640 1 -- 172.21.15.83:0/3286031327 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8030740 con 0x7f15b8105c40 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 -- 172.21.15.83:0/3286031327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 msgr2=0x7f15b8106040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 --2- 172.21.15.83:0/3286031327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8106040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009820 tx=0x7f15a802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 -- 172.21.15.83:0/3286031327 shutdown_connections 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 --2- 172.21.15.83:0/3286031327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8106040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 -- 172.21.15.83:0/3286031327 >> 172.21.15.83:0/3286031327 conn(0x7f15b81013d0 msgr2=0x7f15b8103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 -- 172.21.15.83:0/3286031327 shutdown_connections 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 -- 172.21.15.83:0/3286031327 wait complete. 2024-09-19T08:53:45.967 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.172+0000 7f15bdb17640 1 Processor -- start 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15bdb17640 1 -- start start 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15bdb17640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8102860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15bdb17640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f15b810a1f0 con 0x7f15b8105c40 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8102860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8102860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38296/0 (socket says 172.21.15.83:38296) 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b77fe640 1 -- 172.21.15.83:0/4164037468 learned_addr learned my addr 172.21.15.83:0/4164037468 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b77fe640 1 -- 172.21.15.83:0/4164037468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b819c0e0 con 0x7f15b8105c40 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b77fe640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8102860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097f0 tx=0x7f15a8030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8042070 con 0x7f15b8105c40 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15a8030d80 con 0x7f15b8105c40 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b81a06f0 con 0x7f15b8105c40 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15a8037040 con 0x7f15b8105c40 2024-09-19T08:53:45.968 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.173+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b81a0a90 con 0x7f15b8105c40 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.174+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f15a8045070 con 0x7f15b8105c40 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.174+0000 7f15b4ff9640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15a0039140 0x7f15a003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.174+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f15a806c270 con 0x7f15b8105c40 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.175+0000 7f15b6ffd640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15a0039140 0x7f15a003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.175+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b81060c0 con 0x7f15b8105c40 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.175+0000 7f15b6ffd640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15a0039140 0x7f15a003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0098c0 tx=0x7f15ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.179+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15a8045360 con 0x7f15b8105c40 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.329+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f15a803c660 con 0x7f15b8105c40 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.359+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f15b802da00 con 0x7f15a0039140 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.409+0000 7f15b4ff9640 1 -- 172.21.15.83:0/4164037468 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f15b802da00 con 0x7f15a0039140 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15a0039140 msgr2=0x7f15a003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15a0039140 0x7f15a003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0098c0 tx=0x7f15ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.969 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 msgr2=0x7f15b8102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8102860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097f0 tx=0x7f15a8030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 shutdown_connections 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15a0039140 0x7f15a003b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 --2- 172.21.15.83:0/4164037468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b8105c40 0x7f15b8102860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 >> 172.21.15.83:0/4164037468 conn(0x7f15b81013d0 msgr2=0x7f15b8103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 shutdown_connections 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.411+0000 7f15bdb17640 1 -- 172.21.15.83:0/4164037468 wait complete. 2024-09-19T08:53:45.970 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial admin user... 2024-09-19T08:53:46.084 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:43] ENGINE Serving on https://172.21.15.83:7150 2024-09-19T08:53:46.084 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:43] ENGINE Bus STARTED 2024-09-19T08:53:46.084 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: [19/Sep/2024:08:53:43] ENGINE Error in HTTPServer.serve 2024-09-19T08:53:46.084 INFO:journalctl@ceph.mon.a.smithi083.stdout: Traceback (most recent call last): 2024-09-19T08:53:46.084 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:53:46.084 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._run(expiration_interval) 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: s = self.context.wrap_socket( 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: return self.sslsocket_class._create( 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: self.do_handshake() 2024-09-19T08:53:46.085 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:53:46.086 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._sslobj.do_handshake() 2024-09-19T08:53:46.086 INFO:journalctl@ceph.mon.a.smithi083.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:53:46.086 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:46.086 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: mgrmap e12: x(active, since 2s) 2024-09-19T08:53:46.086 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:46.086 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:46.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:46 smithi083 ceph-mon[30926]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:46.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:48.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:47 smithi083 ceph-mon[30926]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:48.238 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ByNPfyo4tqjoN6vDsIwWdujPQuMWhjR.85vXDJmheepL.M3O5OTfa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726736026, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.358+0000 7fd1b157a640 1 Processor -- start 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.358+0000 7fd1b157a640 1 -- start start 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.358+0000 7fd1b157a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac1079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.358+0000 7fd1b157a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac107f80 con 0x7fd1ac1075b0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.359+0000 7fd1aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac1079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.359+0000 7fd1aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac1079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38310/0 (socket says 172.21.15.83:38310) 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.359+0000 7fd1aaffd640 1 -- 172.21.15.83:0/4098876203 learned_addr learned my addr 172.21.15.83:0/4098876203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.359+0000 7fd1aaffd640 1 -- 172.21.15.83:0/4098876203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac1087b0 con 0x7fd1ac1075b0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.360+0000 7fd1aaffd640 1 --2- 172.21.15.83:0/4098876203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac1079b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009820 tx=0x7fd19c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8a49f6f7d62abf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.360+0000 7fd1a9ffb640 1 -- 172.21.15.83:0/4098876203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd19c037070 con 0x7fd1ac1075b0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.360+0000 7fd1a9ffb640 1 -- 172.21.15.83:0/4098876203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd19c0328f0 con 0x7fd1ac1075b0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.360+0000 7fd1a9ffb640 1 -- 172.21.15.83:0/4098876203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd19c030740 con 0x7fd1ac1075b0 2024-09-19T08:53:48.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 -- 172.21.15.83:0/4098876203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 msgr2=0x7fd1ac1079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 --2- 172.21.15.83:0/4098876203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac1079b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009820 tx=0x7fd19c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 -- 172.21.15.83:0/4098876203 shutdown_connections 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 --2- 172.21.15.83:0/4098876203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac1079b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 -- 172.21.15.83:0/4098876203 >> 172.21.15.83:0/4098876203 conn(0x7fd1ac102d20 msgr2=0x7fd1ac105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 -- 172.21.15.83:0/4098876203 shutdown_connections 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 -- 172.21.15.83:0/4098876203 wait complete. 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 Processor -- start 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.361+0000 7fd1b157a640 1 -- start start 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1b157a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1b157a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac10bb60 con 0x7fd1ac1075b0 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac19b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38322/0 (socket says 172.21.15.83:38322) 2024-09-19T08:53:48.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1aaffd640 1 -- 172.21.15.83:0/3685365766 learned_addr learned my addr 172.21.15.83:0/3685365766 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1aaffd640 1 -- 172.21.15.83:0/3685365766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac19baf0 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1aaffd640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac19b5b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0097f0 tx=0x7fd19c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd19c042070 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd19c030d80 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd19c037040 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac19bd80 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.362+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac19ea70 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.363+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd19c045070 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.363+0000 7fd193fff640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd194039260 0x7fd19403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.363+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd19c06c410 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.363+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac10bce0 con 0x7fd1ac1075b0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.363+0000 7fd1aa7fc640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd194039260 0x7fd19403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.364+0000 7fd1aa7fc640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd194039260 0x7fd19403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00098c0 tx=0x7fd1a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.368+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd19c045520 con 0x7fd1ac1075b0 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.564+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fd1ac107a30 con 0x7fd194039260 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.789+0000 7fd193fff640 1 -- 172.21.15.83:0/3685365766 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fd1ac107a30 con 0x7fd194039260 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd194039260 msgr2=0x7fd19403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd194039260 0x7fd19403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00098c0 tx=0x7fd1a0006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 msgr2=0x7fd1ac19b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac19b5b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0097f0 tx=0x7fd19c030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 shutdown_connections 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd194039260 0x7fd19403b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 --2- 172.21.15.83:0/3685365766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac1075b0 0x7fd1ac19b5b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 >> 172.21.15.83:0/3685365766 conn(0x7fd1ac102d20 msgr2=0x7fd1ac1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 shutdown_connections 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:46.791+0000 7fd1b157a640 1 -- 172.21.15.83:0/3685365766 wait complete. 2024-09-19T08:53:48.242 INFO:teuthology.orchestra.run.smithi083.stdout:Fetching dashboard port number... 2024-09-19T08:53:49.095 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:48 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3022738663' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:53:49.404 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:53:49.404 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f982768d640 1 Processor -- start 2024-09-19T08:53:49.404 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f982768d640 1 -- start start 2024-09-19T08:53:49.404 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f982768d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f98201079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f982768d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9820107f80 con 0x7f98201075b0 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f9825429640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f98201079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f9825429640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f98201079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38332/0 (socket says 172.21.15.83:38332) 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.619+0000 7f9825429640 1 -- 172.21.15.83:0/1352138924 learned_addr learned my addr 172.21.15.83:0/1352138924 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.620+0000 7f9825429640 1 -- 172.21.15.83:0/1352138924 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98201087b0 con 0x7f98201075b0 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.620+0000 7f9825429640 1 --2- 172.21.15.83:0/1352138924 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f98201079b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f981c009820 tx=0x7f981c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725dad52fec7508c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.620+0000 7f9817fff640 1 -- 172.21.15.83:0/1352138924 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981c037070 con 0x7f98201075b0 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f9817fff640 1 -- 172.21.15.83:0/1352138924 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f981c0328f0 con 0x7f98201075b0 2024-09-19T08:53:49.405 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f9817fff640 1 -- 172.21.15.83:0/1352138924 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981c030740 con 0x7f98201075b0 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 -- 172.21.15.83:0/1352138924 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 msgr2=0x7f98201079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 --2- 172.21.15.83:0/1352138924 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f98201079b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f981c009820 tx=0x7f981c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 -- 172.21.15.83:0/1352138924 shutdown_connections 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 --2- 172.21.15.83:0/1352138924 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f98201079b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 -- 172.21.15.83:0/1352138924 >> 172.21.15.83:0/1352138924 conn(0x7f9820102d20 msgr2=0x7f9820105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 -- 172.21.15.83:0/1352138924 shutdown_connections 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.621+0000 7f982768d640 1 -- 172.21.15.83:0/1352138924 wait complete. 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f982768d640 1 Processor -- start 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f982768d640 1 -- start start 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f982768d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f982019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f982768d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f982010bb60 con 0x7f98201075b0 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f9825429640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f982019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.406 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f9825429640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f982019b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38334/0 (socket says 172.21.15.83:38334) 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f9825429640 1 -- 172.21.15.83:0/3022738663 learned_addr learned my addr 172.21.15.83:0/3022738663 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.622+0000 7f9825429640 1 -- 172.21.15.83:0/3022738663 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982019ba90 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.623+0000 7f9825429640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f982019b550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097f0 tx=0x7f981c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.623+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981c042070 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.623+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f981c030d80 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.623+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982019bd20 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.623+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981c037040 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.623+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982019ea10 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.624+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f981c045070 con 0x7f98201075b0 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.624+0000 7f98167fc640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f980c039200 0x7f980c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.407 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.624+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f981c06c450 con 0x7f98201075b0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.624+0000 7f9824c28640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f980c039200 0x7f980c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.624+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982010bce0 con 0x7f98201075b0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.624+0000 7f9824c28640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f980c039200 0x7f980c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98100098c0 tx=0x7f9810006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.629+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f981c04b170 con 0x7f98201075b0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.794+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f982019ebe0 con 0x7f98201075b0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.794+0000 7f98167fc640 1 -- 172.21.15.83:0/3022738663 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f981c045760 con 0x7f98201075b0 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f980c039200 msgr2=0x7f980c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f980c039200 0x7f980c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98100098c0 tx=0x7f9810006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 msgr2=0x7f982019b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f982019b550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097f0 tx=0x7f981c030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 shutdown_connections 2024-09-19T08:53:49.408 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f980c039200 0x7f980c03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.409 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 --2- 172.21.15.83:0/3022738663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98201075b0 0x7f982019b550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.409 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.797+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 >> 172.21.15.83:0/3022738663 conn(0x7f9820102d20 msgr2=0x7f98201038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:49.409 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.798+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 shutdown_connections 2024-09-19T08:53:49.409 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.798+0000 7f982768d640 1 -- 172.21.15.83:0/3022738663 wait complete. 2024-09-19T08:53:49.413 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:53:49.413 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-19T08:53:49.420 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:53:49.420 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-19T08:53:49.420 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-19T08:53:49.421 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:53:49.422 INFO:teuthology.orchestra.run.smithi083.stdout:Ceph Dashboard is now available at: 2024-09-19T08:53:49.422 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:49.423 INFO:teuthology.orchestra.run.smithi083.stdout: URL: https://smithi083.front.sepia.ceph.com:8443/ 2024-09-19T08:53:49.423 INFO:teuthology.orchestra.run.smithi083.stdout: User: admin 2024-09-19T08:53:49.423 INFO:teuthology.orchestra.run.smithi083.stdout: Password: mwmdrb7jom 2024-09-19T08:53:49.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:49.423 INFO:teuthology.orchestra.run.smithi083.stdout:Saving cluster configuration to /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config directory 2024-09-19T08:53:49.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:49 smithi083 ceph-mon[30926]: mgrmap e13: x(active, since 6s) 2024-09-19T08:53:50.726 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.839+0000 7f41a251c640 1 Processor -- start 2024-09-19T08:53:50.726 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f41a251c640 1 -- start start 2024-09-19T08:53:50.726 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f41a251c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c1068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:50.726 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f41a251c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f419c106e80 con 0x7f419c1064b0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f419bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c1068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f419bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c1068b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38348/0 (socket says 172.21.15.83:38348) 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f419bfff640 1 -- 172.21.15.83:0/3291577070 learned_addr learned my addr 172.21.15.83:0/3291577070 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.840+0000 7f419bfff640 1 -- 172.21.15.83:0/3291577070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c1076b0 con 0x7f419c1064b0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.841+0000 7f419bfff640 1 --2- 172.21.15.83:0/3291577070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c1068b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f418c009820 tx=0x7f418c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4eb813acf38596b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.843+0000 7f419affd640 1 -- 172.21.15.83:0/3291577070 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c037070 con 0x7f419c1064b0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.843+0000 7f419affd640 1 -- 172.21.15.83:0/3291577070 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f418c0328f0 con 0x7f419c1064b0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.843+0000 7f419affd640 1 -- 172.21.15.83:0/3291577070 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c030740 con 0x7f419c1064b0 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 -- 172.21.15.83:0/3291577070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 msgr2=0x7f419c1068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 --2- 172.21.15.83:0/3291577070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c1068b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f418c009820 tx=0x7f418c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 -- 172.21.15.83:0/3291577070 shutdown_connections 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 --2- 172.21.15.83:0/3291577070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c1068b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.727 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 -- 172.21.15.83:0/3291577070 >> 172.21.15.83:0/3291577070 conn(0x7f419c101cc0 msgr2=0x7f419c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 -- 172.21.15.83:0/3291577070 shutdown_connections 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 -- 172.21.15.83:0/3291577070 wait complete. 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 Processor -- start 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.844+0000 7f41a251c640 1 -- start start 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f41a251c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c075520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f41a251c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10aa60 con 0x7f419c1064b0 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f419bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c075520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f419bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c075520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38364/0 (socket says 172.21.15.83:38364) 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f419bfff640 1 -- 172.21.15.83:0/3092096372 learned_addr learned my addr 172.21.15.83:0/3092096372 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f419bfff640 1 -- 172.21.15.83:0/3092096372 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c19e2f0 con 0x7f419c1064b0 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f419bfff640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c075520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f418c0097f0 tx=0x7f418c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c042070 con 0x7f419c1064b0 2024-09-19T08:53:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c19e4c0 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f418c030d80 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.845+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c037040 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.846+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c19e860 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.846+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f418c045070 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.846+0000 7f41997fa640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f41880392a0 0x7f418803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.847+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f418c06c550 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.846+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c10abe0 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.847+0000 7f419b7fe640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f41880392a0 0x7f418803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.847+0000 7f419b7fe640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f41880392a0 0x7f418803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41840098c0 tx=0x7f4184006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.851+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f418c02ed90 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.108+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f419c19eba0 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.111+0000 7f41997fa640 1 -- 172.21.15.83:0/3092096372 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f418c03db00 con 0x7f419c1064b0 2024-09-19T08:53:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f41880392a0 msgr2=0x7f418803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f41880392a0 0x7f418803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f41840098c0 tx=0x7f4184006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 msgr2=0x7f419c075520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c075520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f418c0097f0 tx=0x7f418c030c70 comp rx=0 tx=0).stop 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 shutdown_connections 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f41880392a0 0x7f418803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 --2- 172.21.15.83:0/3092096372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f419c1064b0 0x7f419c075520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 >> 172.21.15.83:0/3092096372 conn(0x7f419c101cc0 msgr2=0x7f419c102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.113+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 shutdown_connections 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.114+0000 7f41a251c640 1 -- 172.21.15.83:0/3092096372 wait complete. 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.730 INFO:teuthology.orchestra.run.smithi083.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: ceph telemetry on 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout:For more information see: 2024-09-19T08:53:50.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.732 INFO:teuthology.orchestra.run.smithi083.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:53:50.732 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:53:50.732 INFO:teuthology.orchestra.run.smithi083.stdout:Bootstrap complete. 2024-09-19T08:53:50.762 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:53:50.763 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:53:50.763 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:53:50.779 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:53:50.779 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:53:50.779 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:53:50.836 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:53:50.836 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:53:50.836 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:53:50.901 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:53:50.902 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:53:50.902 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:53:50.957 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:53:50.958 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:53:51.031 INFO:teuthology.orchestra.run.smithi083.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:51.042 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:53:51.171 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:51.185 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:53:51.230 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkXv0qPAkzD1uZudcQMMLRe1zxBYDAtIdeMsT6xE3rvfbr07GnNtfLoCWBzDITuaxkE0/RQz7HSd2H031MVRwMHtp3ZNwd6TUbGNlGHIpIamlbEh16V0Te35LgkgSJWZs0fOJTzpmgTEUhXifbQT/rBixy8TVOtjm3gytnFJ937c3x4zYjCZTvSzi6FD2wbfJQ+Q0vAJG/JcmqoK/6iaOCUEVXGxpfA0qP4E3y1wEhE/XxR8LXuvPNU0fV17n4V/WY4BRAULf7+2kl9dUXh6p4hcJ+eN2XeESAHbs4ITIHVec/aMK5c0UKVlLKYFnjpZDtVcOblbevdeE1Vao0V7GaBl6pSXj+wuCmtVsjKRoOpcrZnZdXC5efFgwvb4fEXIPG43C95dFCzYI9UB2oA3yF4GeYaxNmnm1614xtrz1smd5EsjQL6JAz4QljuScr43/9pcGeZ6Zq+KLo+kE9X8qTpNWBzFXtbJAb8btrUvs1v5s6mBGORey0sJ7faIwFGbM= ceph-68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:51.242 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:53:51.331 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:51 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3092096372' entity='client.admin' 2024-09-19T08:53:51.493 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:51.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 -- 172.21.15.83:0/3022845247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 msgr2=0x7fa234104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 --2- 172.21.15.83:0/3022845247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa224009c20 tx=0x7fa22402aa90 comp rx=0 tx=0).stop 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 -- 172.21.15.83:0/3022845247 shutdown_connections 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 --2- 172.21.15.83:0/3022845247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 -- 172.21.15.83:0/3022845247 >> 172.21.15.83:0/3022845247 conn(0x7fa2340fbc80 msgr2=0x7fa2340fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 -- 172.21.15.83:0/3022845247 shutdown_connections 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.984+0000 7fa23bded640 1 -- 172.21.15.83:0/3022845247 wait complete. 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa23bded640 1 Processor -- start 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa23bded640 1 -- start start 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa23bded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa23bded640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa234107560 con 0x7fa2341020a0 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa239b89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa239b89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47222/0 (socket says 172.21.15.83:47222) 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa239b89640 1 -- 172.21.15.83:0/4242331324 learned_addr learned my addr 172.21.15.83:0/4242331324 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:51.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.985+0000 7fa239b89640 1 -- 172.21.15.83:0/4242331324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa234197200 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.986+0000 7fa239b89640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa224030f50 tx=0x7fa224030f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.986+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa224047070 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.986+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa224003e20 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.986+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa224033050 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.986+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2341974f0 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.986+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23419a180 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.987+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa22404a070 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.987+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa234107ce0 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.987+0000 7fa232ffd640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa21c0392a0 0x7fa21c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.987+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa22403e030 con 0x7fa2341020a0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.987+0000 7fa239388640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa21c0392a0 0x7fa21c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.987+0000 7fa239388640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa21c0392a0 0x7fa21c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2280098c0 tx=0x7fa228006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:51.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:51.991+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa224048260 con 0x7fa2341020a0 2024-09-19T08:53:52.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.158+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fa23402d9b0 con 0x7fa2341020a0 2024-09-19T08:53:52.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.161+0000 7fa232ffd640 1 -- 172.21.15.83:0/4242331324 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fa224004040 con 0x7fa2341020a0 2024-09-19T08:53:52.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa21c0392a0 msgr2=0x7fa21c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa21c0392a0 0x7fa21c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2280098c0 tx=0x7fa228006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 msgr2=0x7fa234196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa224030f50 tx=0x7fa224030f80 comp rx=0 tx=0).stop 2024-09-19T08:53:52.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 shutdown_connections 2024-09-19T08:53:52.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa21c0392a0 0x7fa21c03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 --2- 172.21.15.83:0/4242331324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2341020a0 0x7fa234196cc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.163+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 >> 172.21.15.83:0/4242331324 conn(0x7fa2340fbc80 msgr2=0x7fa2340fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:52.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.164+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 shutdown_connections 2024-09-19T08:53:52.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:52.164+0000 7fa23bded640 1 -- 172.21.15.83:0/4242331324 wait complete. 2024-09-19T08:53:53.245 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:53:53.245 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4242331324' entity='client.admin' 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:53.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:53.485 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:53.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 -- 172.21.15.83:0/2535107224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 msgr2=0x7fa328100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:53.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 --2- 172.21.15.83:0/2535107224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328100900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa318009880 tx=0x7fa31802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 -- 172.21.15.83:0/2535107224 shutdown_connections 2024-09-19T08:53:53.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 --2- 172.21.15.83:0/2535107224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328100900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 -- 172.21.15.83:0/2535107224 >> 172.21.15.83:0/2535107224 conn(0x7fa3280fbc90 msgr2=0x7fa3280fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:53.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 -- 172.21.15.83:0/2535107224 shutdown_connections 2024-09-19T08:53:53.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.990+0000 7fa32d591640 1 -- 172.21.15.83:0/2535107224 wait complete. 2024-09-19T08:53:53.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa32d591640 1 Processor -- start 2024-09-19T08:53:53.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa32d591640 1 -- start start 2024-09-19T08:53:53.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa32d591640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:53.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa32d591640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa3281064c0 con 0x7fa328100500 2024-09-19T08:53:53.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa326ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa326ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47234/0 (socket says 172.21.15.83:47234) 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.991+0000 7fa326ffd640 1 -- 172.21.15.83:0/3221738763 learned_addr learned my addr 172.21.15.83:0/3221738763 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa326ffd640 1 -- 172.21.15.83:0/3221738763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa328196100 con 0x7fa328100500 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa326ffd640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328195bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa318009230 tx=0x7fa3180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa31803f070 con 0x7fa328100500 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa328196390 con 0x7fa328100500 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa318003aa0 con 0x7fa328100500 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa318035030 con 0x7fa328100500 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.992+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa328199080 con 0x7fa328100500 2024-09-19T08:53:53.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.993+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa318042070 con 0x7fa328100500 2024-09-19T08:53:53.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.993+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa328106c40 con 0x7fa328100500 2024-09-19T08:53:53.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.993+0000 7fa324ff9640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa3140392a0 0x7fa31403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:53.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.993+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa31806d150 con 0x7fa328100500 2024-09-19T08:53:53.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.993+0000 7fa31ffff640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa3140392a0 0x7fa31403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:53.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.994+0000 7fa31ffff640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa3140392a0 0x7fa31403b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3100098c0 tx=0x7fa310006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:53.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:53.998+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa318039350 con 0x7fa328100500 2024-09-19T08:53:54.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.169+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa32802d830 con 0x7fa3140392a0 2024-09-19T08:53:54.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.172+0000 7fa324ff9640 1 -- 172.21.15.83:0/3221738763 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa32802d830 con 0x7fa3140392a0 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa3140392a0 msgr2=0x7fa31403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa3140392a0 0x7fa31403b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3100098c0 tx=0x7fa310006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 msgr2=0x7fa328195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328195bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa318009230 tx=0x7fa3180048f0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 shutdown_connections 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa3140392a0 0x7fa31403b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 --2- 172.21.15.83:0/3221738763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa328100500 0x7fa328195bc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 >> 172.21.15.83:0/3221738763 conn(0x7fa3280fbc90 msgr2=0x7fa3280fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:54.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 shutdown_connections 2024-09-19T08:53:54.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:54.175+0000 7fa32d591640 1 -- 172.21.15.83:0/3221738763 wait complete. 2024-09-19T08:53:54.992 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2024-09-19T08:53:54.992 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:53:54.992 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:53:55.012 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:53:55.012 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:55.069 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2024-09-19T08:53:55.070 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch host add smithi122 2024-09-19T08:53:55.306 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:55.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:55.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:53:55.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 -- 172.21.15.83:0/3039227900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 msgr2=0x7fe4f4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 --2- 172.21.15.83:0/3039227900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009880 tx=0x7fe4e402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 -- 172.21.15.83:0/3039227900 shutdown_connections 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 --2- 172.21.15.83:0/3039227900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 -- 172.21.15.83:0/3039227900 >> 172.21.15.83:0/3039227900 conn(0x7fe4f40fc1b0 msgr2=0x7fe4f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 -- 172.21.15.83:0/3039227900 shutdown_connections 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.738+0000 7fe4faed5640 1 -- 172.21.15.83:0/3039227900 wait complete. 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4faed5640 1 Processor -- start 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4faed5640 1 -- start start 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4faed5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4faed5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f410aa40 con 0x7fe4f4106560 2024-09-19T08:53:55.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4f8c71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4f8c71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47248/0 (socket says 172.21.15.83:47248) 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.739+0000 7fe4f8c71640 1 -- 172.21.15.83:0/578863665 learned_addr learned my addr 172.21.15.83:0/578863665 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4f8c71640 1 -- 172.21.15.83:0/578863665 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f4196460 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4f8c71640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4195f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009230 tx=0x7fe4e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e403f070 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f41966f0 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4e4004d10 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e4035030 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.740+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f419a7f0 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.741+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe4e4042070 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.741+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f4101bd0 con 0x7fe4f4106560 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.741+0000 7fe4f1ffb640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4dc0392a0 0x7fe4dc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.741+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe4e406d140 con 0x7fe4f4106560 2024-09-19T08:53:55.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.741+0000 7fe4f3fff640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4dc0392a0 0x7fe4dc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.742+0000 7fe4f3fff640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4dc0392a0 0x7fe4dc03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80098c0 tx=0x7fe4e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.746+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4e4039350 con 0x7fe4f4106560 2024-09-19T08:53:55.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:55.915+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}) -- 0x7fe4f41069c0 con 0x7fe4dc0392a0 2024-09-19T08:53:56.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:56 smithi083 ceph-mon[30926]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:53:57 smithi083 ceph-mon[30926]: Deploying cephadm binary to smithi122 2024-09-19T08:53:59.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.103+0000 7fe4f1ffb640 1 -- 172.21.15.83:0/578863665 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe4f41069c0 con 0x7fe4dc0392a0 2024-09-19T08:53:59.103 INFO:teuthology.orchestra.run.smithi083.stdout:Added host 'smithi122' with addr '172.21.15.122' 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4dc0392a0 msgr2=0x7fe4dc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4dc0392a0 0x7fe4dc03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80098c0 tx=0x7fe4e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 msgr2=0x7fe4f4195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4195f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009230 tx=0x7fe4e40048f0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 shutdown_connections 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4dc0392a0 0x7fe4dc03b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 --2- 172.21.15.83:0/578863665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4f4106560 0x7fe4f4195f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 >> 172.21.15.83:0/578863665 conn(0x7fe4f40fc1b0 msgr2=0x7fe4f40fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 shutdown_connections 2024-09-19T08:53:59.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:53:59.105+0000 7fe4faed5640 1 -- 172.21.15.83:0/578863665 wait complete. 2024-09-19T08:53:59.739 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:53:59.975 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:00.372 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:00.372 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:00 smithi083 ceph-mon[30926]: Added host smithi122 2024-09-19T08:54:00.372 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:00.372 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:00.372 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:00.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 -- 172.21.15.83:0/2714916445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 msgr2=0x7fcedc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:00.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 --2- 172.21.15.83:0/2714916445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009880 tx=0x7fcecc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 -- 172.21.15.83:0/2714916445 shutdown_connections 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 --2- 172.21.15.83:0/2714916445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 -- 172.21.15.83:0/2714916445 >> 172.21.15.83:0/2714916445 conn(0x7fcedc0fd290 msgr2=0x7fcedc0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 -- 172.21.15.83:0/2714916445 shutdown_connections 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 -- 172.21.15.83:0/2714916445 wait complete. 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 Processor -- start 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.451+0000 7fcee28fa640 1 -- start start 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcee28fa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcee28fa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc10bb40 con 0x7fcedc107660 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcedbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcedbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58664/0 (socket says 172.21.15.83:58664) 2024-09-19T08:54:00.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcedbfff640 1 -- 172.21.15.83:0/1863118061 learned_addr learned my addr 172.21.15.83:0/1863118061 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcedbfff640 1 -- 172.21.15.83:0/1863118061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc197580 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.452+0000 7fcedbfff640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc197040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009230 tx=0x7fcecc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.453+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc03f070 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.453+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcecc004d10 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.453+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc035030 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.453+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc197810 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.453+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcedc19b910 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.454+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fcecc042070 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.454+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcedc102cd0 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.454+0000 7fced97fa640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcec8039300 0x7fcec803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.454+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcecc06cfc0 con 0x7fcedc107660 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.454+0000 7fcedb7fe640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcec8039300 0x7fcec803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:00.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.454+0000 7fcedb7fe640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcec8039300 0x7fcec803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcec40098c0 tx=0x7fcec4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:00.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.459+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcecc039350 con 0x7fcedc107660 2024-09-19T08:54:00.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.631+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcedc1983a0 con 0x7fcec8039300 2024-09-19T08:54:00.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.632+0000 7fced97fa640 1 -- 172.21.15.83:0/1863118061 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fcedc1983a0 con 0x7fcec8039300 2024-09-19T08:54:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:54:00.633 INFO:teuthology.orchestra.run.smithi083.stdout:[{"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2024-09-19T08:54:00.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcec8039300 msgr2=0x7fcec803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:00.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcec8039300 0x7fcec803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcec40098c0 tx=0x7fcec4006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 msgr2=0x7fcedc197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc197040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009230 tx=0x7fcecc0048f0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 shutdown_connections 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcec8039300 0x7fcec803b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 --2- 172.21.15.83:0/1863118061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcedc107660 0x7fcedc197040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 >> 172.21.15.83:0/1863118061 conn(0x7fcedc0fd290 msgr2=0x7fcedc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 shutdown_connections 2024-09-19T08:54:00.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:00.635+0000 7fcee28fa640 1 -- 172.21.15.83:0/1863118061 wait complete. 2024-09-19T08:54:01.271 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2024-09-19T08:54:01.271 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:54:01.271 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:54:01.290 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:54:01.290 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:01.349 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2024-09-19T08:54:01.350 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch host add smithi184 2024-09-19T08:54:01.590 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:01.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:01.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:01 smithi083 ceph-mon[30926]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:02.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 -- 172.21.15.83:0/2332093461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 msgr2=0x7f7a94106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 --2- 172.21.15.83:0/2332093461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009c10 tx=0x7f7a8402aa10 comp rx=0 tx=0).stop 2024-09-19T08:54:02.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 -- 172.21.15.83:0/2332093461 shutdown_connections 2024-09-19T08:54:02.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 --2- 172.21.15.83:0/2332093461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 -- 172.21.15.83:0/2332093461 >> 172.21.15.83:0/2332093461 conn(0x7f7a94077310 msgr2=0x7f7a940fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 -- 172.21.15.83:0/2332093461 shutdown_connections 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.042+0000 7f7a99496640 1 -- 172.21.15.83:0/2332093461 wait complete. 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a99496640 1 Processor -- start 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a99496640 1 -- start start 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a99496640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a99496640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9410aa20 con 0x7f7a94106540 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a92ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a92ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58670/0 (socket says 172.21.15.83:58670) 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.043+0000 7f7a92ffd640 1 -- 172.21.15.83:0/1500227572 learned_addr learned my addr 172.21.15.83:0/1500227572 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a92ffd640 1 -- 172.21.15.83:0/1500227572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a94197570 con 0x7f7a94106540 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a92ffd640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94197030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a84005dd0 tx=0x7f7a8402f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a84034070 con 0x7f7a94106540 2024-09-19T08:54:02.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a94197800 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a8402feb0 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a84004360 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.044+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a94197c80 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.045+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7a84037020 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.045+0000 7f7a8bfff640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7a800392a0 0x7f7a8003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.045+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a94101bb0 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.045+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7a8406d200 con 0x7f7a94106540 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.045+0000 7f7a927fc640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7a800392a0 0x7f7a8003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.045+0000 7f7a927fc640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7a800392a0 0x7f7a8003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0098c0 tx=0x7f7a7c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.050+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7a8403f070 con 0x7f7a94106540 2024-09-19T08:54:02.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:02.219+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}) -- 0x7f7a94104950 con 0x7f7a800392a0 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:05.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:04 smithi083 ceph-mon[30926]: Deploying cephadm binary to smithi184 2024-09-19T08:54:05.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:04 smithi083 ceph-mon[30926]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T08:54:05.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:04 smithi083 ceph-mon[30926]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:05.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:04 smithi083 ceph-mon[30926]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:05.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.323+0000 7f7a8bfff640 1 -- 172.21.15.83:0/1500227572 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f7a94104950 con 0x7f7a800392a0 2024-09-19T08:54:05.324 INFO:teuthology.orchestra.run.smithi083.stdout:Added host 'smithi184' with addr '172.21.15.184' 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7a800392a0 msgr2=0x7f7a8003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7a800392a0 0x7f7a8003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0098c0 tx=0x7f7a7c006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 msgr2=0x7f7a94197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94197030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a84005dd0 tx=0x7f7a8402f980 comp rx=0 tx=0).stop 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 shutdown_connections 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7a800392a0 0x7f7a8003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 --2- 172.21.15.83:0/1500227572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a94106540 0x7f7a94197030 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 >> 172.21.15.83:0/1500227572 conn(0x7f7a94077310 msgr2=0x7f7a94104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 shutdown_connections 2024-09-19T08:54:05.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:05.325+0000 7f7a99496640 1 -- 172.21.15.83:0/1500227572 wait complete. 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:05.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:05.909 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:05.939 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:54:06.175 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:06.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 -- 172.21.15.83:0/335579650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 msgr2=0x7f0440106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:06.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 --2- 172.21.15.83:0/335579650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0430009880 tx=0x7f043002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 -- 172.21.15.83:0/335579650 shutdown_connections 2024-09-19T08:54:06.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 --2- 172.21.15.83:0/335579650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 -- 172.21.15.83:0/335579650 >> 172.21.15.83:0/335579650 conn(0x7f04400fc1b0 msgr2=0x7f04400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 -- 172.21.15.83:0/335579650 shutdown_connections 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.634+0000 7f04460cb640 1 -- 172.21.15.83:0/335579650 wait complete. 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f04460cb640 1 Processor -- start 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f04460cb640 1 -- start start 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f04460cb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f04460cb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f044010aa40 con 0x7f0440106560 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f043f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f043f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58698/0 (socket says 172.21.15.83:58698) 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f043f7fe640 1 -- 172.21.15.83:0/3779353430 learned_addr learned my addr 172.21.15.83:0/3779353430 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f043f7fe640 1 -- 172.21.15.83:0/3779353430 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04401983b0 con 0x7f0440106560 2024-09-19T08:54:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.635+0000 7f043f7fe640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440197e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0430009230 tx=0x7f04300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.636+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043003f070 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.636+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0430004d10 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.636+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430035030 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.636+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0440198640 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.636+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0440198aa0 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.637+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0430042070 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.637+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0440101bd0 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.637+0000 7f043d7fa640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f042c039300 0x7f042c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.637+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f043006cf30 con 0x7f0440106560 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.637+0000 7f0437fff640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f042c039300 0x7f042c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.637+0000 7f0437fff640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f042c039300 0x7f042c03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04280098c0 tx=0x7f0428006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.642+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0430042360 con 0x7f0440106560 2024-09-19T08:54:06.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.814+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04401069c0 con 0x7f042c039300 2024-09-19T08:54:06.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.815+0000 7f043d7fa640 1 -- 172.21.15.83:0/3779353430 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f04401069c0 con 0x7f042c039300 2024-09-19T08:54:06.815 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:54:06.815 INFO:teuthology.orchestra.run.smithi083.stdout:[{"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2024-09-19T08:54:06.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f042c039300 msgr2=0x7f042c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:06.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f042c039300 0x7f042c03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04280098c0 tx=0x7f0428006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 msgr2=0x7f0440197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440197e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0430009230 tx=0x7f04300048f0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 shutdown_connections 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f042c039300 0x7f042c03b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 --2- 172.21.15.83:0/3779353430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0440106560 0x7f0440197e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 >> 172.21.15.83:0/3779353430 conn(0x7f04400fc1b0 msgr2=0x7f04400fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 shutdown_connections 2024-09-19T08:54:06.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:06.818+0000 7f04460cb640 1 -- 172.21.15.83:0/3779353430 wait complete. 2024-09-19T08:54:07.123 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:06 smithi083 ceph-mon[30926]: Added host smithi184 2024-09-19T08:54:07.123 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:07.123 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:07.436 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:54:07.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:54:07.676 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:08.069 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:07 smithi083 ceph-mon[30926]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:08.069 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:07 smithi083 ceph-mon[30926]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:08.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 -- 172.21.15.83:0/3345677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 msgr2=0x7f2ad0107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 --2- 172.21.15.83:0/3345677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009880 tx=0x7f2ac002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 -- 172.21.15.83:0/3345677465 shutdown_connections 2024-09-19T08:54:08.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 --2- 172.21.15.83:0/3345677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 -- 172.21.15.83:0/3345677465 >> 172.21.15.83:0/3345677465 conn(0x7f2ad00fd2b0 msgr2=0x7f2ad00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 -- 172.21.15.83:0/3345677465 shutdown_connections 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 -- 172.21.15.83:0/3345677465 wait complete. 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.149+0000 7f2ad5d96640 1 Processor -- start 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2ad5d96640 1 -- start start 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2ad5d96640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2ad5d96640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010bb40 con 0x7f2ad0107660 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58716/0 (socket says 172.21.15.83:58716) 2024-09-19T08:54:08.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acf7fe640 1 -- 172.21.15.83:0/1792554300 learned_addr learned my addr 172.21.15.83:0/1792554300 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acf7fe640 1 -- 172.21.15.83:0/1792554300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad0197570 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acf7fe640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0197030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009230 tx=0x7f2ac00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac003f070 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad0197800 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ac0004d10 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0035030 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.150+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad019b900 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.151+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2ac0042070 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.151+0000 7f2acd7fa640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2abc0392a0 0x7f2abc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.151+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ac006d020 con 0x7f2ad0107660 2024-09-19T08:54:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.152+0000 7f2ac7fff640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2abc0392a0 0x7f2abc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.152+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad0102cd0 con 0x7f2ad0107660 2024-09-19T08:54:08.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.152+0000 7f2ac7fff640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2abc0392a0 0x7f2abc03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098c0 tx=0x7f2ab8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.156+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ac0039350 con 0x7f2ad0107660 2024-09-19T08:54:08.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.324+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2ad0107af0 con 0x7f2ad0107660 2024-09-19T08:54:08.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.897+0000 7f2acd7fa640 1 -- 172.21.15.83:0/1792554300 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f2ad0107af0 con 0x7f2ad0107660 2024-09-19T08:54:08.897 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-09-19T08:54:08.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2abc0392a0 msgr2=0x7f2abc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2abc0392a0 0x7f2abc03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098c0 tx=0x7f2ab8006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 msgr2=0x7f2ad0197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0197030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009230 tx=0x7f2ac00048f0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 shutdown_connections 2024-09-19T08:54:08.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2abc0392a0 0x7f2abc03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 --2- 172.21.15.83:0/1792554300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ad0107660 0x7f2ad0197030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.899+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 >> 172.21.15.83:0/1792554300 conn(0x7f2ad00fd2b0 msgr2=0x7f2ad00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.900+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 shutdown_connections 2024-09-19T08:54:08.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:08.900+0000 7f2ad5d96640 1 -- 172.21.15.83:0/1792554300 wait complete. 2024-09-19T08:54:09.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:08 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1792554300' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:54:09.502 INFO:tasks.cephadm:Adding mon.a on smithi083 2024-09-19T08:54:09.502 INFO:tasks.cephadm:Adding mon.b on smithi122 2024-09-19T08:54:09.503 INFO:tasks.cephadm:Adding mon.c on smithi184 2024-09-19T08:54:09.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c' 2024-09-19T08:54:09.745 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:09.790 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1792554300' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:10.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:10.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2015853880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 msgr2=0x7f4bc41019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 --2- 172.21.15.184:0/2015853880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc41019e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009880 tx=0x7f4bb402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2015853880 shutdown_connections 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 --2- 172.21.15.184:0/2015853880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc41019e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2015853880 >> 172.21.15.184:0/2015853880 conn(0x7f4bc40fcd70 msgr2=0x7f4bc40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2015853880 shutdown_connections 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.283+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2015853880 wait complete. 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.284+0000 7f4bc8abc640 1 Processor -- start 2024-09-19T08:54:10.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.284+0000 7f4bc8abc640 1 -- start start 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.284+0000 7f4bc8abc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.284+0000 7f4bc8abc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41075a0 con 0x7f4bc41015e0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc4196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.184:41324/0 (socket says 172.21.15.184:41324) 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc259c640 1 -- 172.21.15.184:0/2590446375 learned_addr learned my addr 172.21.15.184:0/2590446375 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc259c640 1 -- 172.21.15.184:0/2590446375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc41971e0 con 0x7f4bc41015e0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc259c640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc4196ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4005ec0 tx=0x7f4bb40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb403f070 con 0x7f4bc41015e0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4bb4003aa0 con 0x7f4bc41015e0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb4035030 con 0x7f4bc41015e0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc4197470 con 0x7f4bc41015e0 2024-09-19T08:54:10.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.285+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc419a160 con 0x7f4bc41015e0 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.286+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4bb4042070 con 0x7f4bc41015e0 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.286+0000 7f4bbbfff640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4bb0039300 0x7f4bb003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.286+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4bb406e040 con 0x7f4bc41015e0 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.287+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc4107d20 con 0x7f4bc41015e0 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.287+0000 7f4bb9d9b640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4bb0039300 0x7f4bb003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.287+0000 7f4bb9d9b640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4bb0039300 0x7f4bb003b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0098c0 tx=0x7f4bac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.291+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4bb40433b0 con 0x7f4bc41015e0 2024-09-19T08:54:10.479 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.479+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}) -- 0x7f4bc4062630 con 0x7f4bb0039300 2024-09-19T08:54:10.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.484+0000 7f4bbbfff640 1 -- 172.21.15.184:0/2590446375 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4bc4062630 con 0x7f4bb0039300 2024-09-19T08:54:10.484 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mon update... 2024-09-19T08:54:10.486 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4bb0039300 msgr2=0x7f4bb003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.486 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4bb0039300 0x7f4bb003b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0098c0 tx=0x7f4bac006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.486 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 msgr2=0x7f4bc4196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.486 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc4196ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4005ec0 tx=0x7f4bb40048f0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.487 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 shutdown_connections 2024-09-19T08:54:10.487 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4bb0039300 0x7f4bb003b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.487 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 --2- 172.21.15.184:0/2590446375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bc41015e0 0x7f4bc4196ca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.487 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 >> 172.21.15.184:0/2590446375 conn(0x7f4bc40fcd70 msgr2=0x7f4bc40fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.487 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 shutdown_connections 2024-09-19T08:54:10.487 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:10.486+0000 7f4bc8abc640 1 -- 172.21.15.184:0/2590446375 wait complete. 2024-09-19T08:54:11.036 DEBUG:teuthology.orchestra.run.smithi122:mon.b> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:54:11.039 DEBUG:teuthology.orchestra.run.smithi184:mon.c> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:54:11.041 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:54:11.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:11.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:12.045 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:11 smithi083 ceph-mon[30926]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:11 smithi083 ceph-mon[30926]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:54:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:11 smithi083 ceph-mon[30926]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:11 smithi083 ceph-mon[30926]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c;count:3 2024-09-19T08:54:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:11 smithi083 ceph-mon[30926]: Deploying daemon mon.c on smithi184 2024-09-19T08:54:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:11 smithi083 ceph-mon[30926]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:12.817 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 -- 172.21.15.184:0/222442261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 msgr2=0x7fde2c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:12.817 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 --2- 172.21.15.184:0/222442261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fde28009c20 tx=0x7fde2802aa90 comp rx=0 tx=0).stop 2024-09-19T08:54:12.817 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 -- 172.21.15.184:0/222442261 shutdown_connections 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 --2- 172.21.15.184:0/222442261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 -- 172.21.15.184:0/222442261 >> 172.21.15.184:0/222442261 conn(0x7fde2c0fd290 msgr2=0x7fde2c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 -- 172.21.15.184:0/222442261 shutdown_connections 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 -- 172.21.15.184:0/222442261 wait complete. 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 Processor -- start 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.817+0000 7fde335f1640 1 -- start start 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde335f1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:12.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde335f1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c10bb40 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde3138d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde3138d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.184:41350/0 (socket says 172.21.15.184:41350) 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde3138d640 1 -- 172.21.15.184:0/1630079128 learned_addr learned my addr 172.21.15.184:0/1630079128 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde3138d640 1 -- 172.21.15.184:0/1630079128 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c1975e0 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.818+0000 7fde3138d640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c1970a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde28005e30 tx=0x7fde2802b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.819+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde28047070 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.819+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde28003e20 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.819+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c197870 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.819+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde28033050 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.819+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c197c70 con 0x7fde2c107660 2024-09-19T08:54:12.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.820+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fde2804a070 con 0x7fde2c107660 2024-09-19T08:54:12.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.820+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2c102cd0 con 0x7fde2c107660 2024-09-19T08:54:12.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.820+0000 7fde227fc640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde180392a0 0x7fde1803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:12.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.820+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fde2803e030 con 0x7fde2c107660 2024-09-19T08:54:12.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.820+0000 7fde30b8c640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde180392a0 0x7fde1803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:12.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.820+0000 7fde30b8c640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde180392a0 0x7fde1803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0098c0 tx=0x7fde1c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:12.824 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:12.825+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde2802edf0 con 0x7fde2c107660 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.063+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fde2c198490 con 0x7fde2c107660 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.064+0000 7fde227fc640 1 -- 172.21.15.184:0/1630079128 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fde28051300 con 0x7fde2c107660 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:54:13.064 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:47.071352Z","created":"2024-09-19T08:52:47.071352Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:13.064 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-09-19T08:54:13.066 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde180392a0 msgr2=0x7fde1803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.066 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde180392a0 0x7fde1803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0098c0 tx=0x7fde1c006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.066 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 msgr2=0x7fde2c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.066 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c1970a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde28005e30 tx=0x7fde2802b010 comp rx=0 tx=0).stop 2024-09-19T08:54:13.066 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 shutdown_connections 2024-09-19T08:54:13.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde180392a0 0x7fde1803b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 --2- 172.21.15.184:0/1630079128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde2c107660 0x7fde2c1970a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 >> 172.21.15.184:0/1630079128 conn(0x7fde2c0fd290 msgr2=0x7fde2c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 shutdown_connections 2024-09-19T08:54:13.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:13.066+0000 7fde335f1640 1 -- 172.21.15.184:0/1630079128 wait complete. 2024-09-19T08:54:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:13 smithi083 ceph-mon[30926]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:13 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/1630079128' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.wal_compression: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:54:15.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:54:15.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:54:15.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:54:15.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:54:15.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:54:15.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:54:15.415 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:54:15.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:54:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_open_files: -1 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Compression algorithms supported: 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kZSTD supported: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:54:15.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.merge_operator: 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_filter: None 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:54:15.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5604d3785320) 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_type: 0 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_index_type: 0 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_shortening: 1 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: checksum: 4 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: no_block_cache: 0 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache: 0x5604d37791f0 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_options: 2024-09-19T08:54:15.653 INFO:journalctl@ceph.mon.c.smithi184.stdout: capacity : 536870912 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_shard_bits : 4 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: strict_capacity_limit : 0 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_compressed: (nil) 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: persistent_cache: (nil) 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size: 4096 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size_deviation: 10 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_restart_interval: 16 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_block_restart_interval: 1 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: metadata_block_size: 4096 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: partition_filters: 0 2024-09-19T08:54:15.654 INFO:journalctl@ceph.mon.c.smithi184.stdout: use_delta_encoding: 1 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: filter_policy: bloomfilter 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: whole_key_filtering: 1 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: verify_compression: 0 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: format_version: 5 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_index_compression: 1 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_align: 0 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: max_auto_readahead_size: 262144 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: prepopulate_block_cache: 0 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:54:15.655 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression: NoCompression 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.num_levels: 7 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:54:15.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:54:15.657 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:54:15.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:54:15.659 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:54:15.660 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:54:15.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.ttl: 2592000 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:54:15.662 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cab89f66-cf45-4c7e-a0df-c81bb50c76a9 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736055342813, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736055343367, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726736055, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cab89f66-cf45-4c7e-a0df-c81bb50c76a9", "db_session_id": "WAFKN9GW2BHWJIT4NFFT", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736055343492, "job": 1, "event": "recovery_finished"} 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5604d37a6e00 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: DB pointer 0x5604d38a2000 2024-09-19T08:54:15.663 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** DB Stats ** 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:54:15.664 INFO:journalctl@ceph.mon.c.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:54:15.665 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache BinnedLRUCache@0x5604d37791f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: using public_addr v2:172.21.15.184:0/0 -> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: starting mon.c rank -1 at public addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] at bind addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:15.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(???) e0 preinit fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: e1 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: btime 2024-09-19T08:52:50:113112+0000 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: legacy client fscid: -1 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout: No filesystems configured 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:54:15.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1792554300' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1792554300' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:54:15.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c;count:3 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: Deploying daemon mon.c on smithi184 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/1630079128' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 ceph-mon[35007]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 bash[34988]: fd8b0b47c331434612e4b34b5f36648bfd45ba4491b124e2f39550671bcca2e5 2024-09-19T08:54:15.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:15 smithi184 systemd[1]: Started Ceph mon.c for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:54:15.740 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:54:20.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.508+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4196623167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58106650 msgr2=0x7fbf44005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.508+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4196623167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58106650 0x7fbf44005580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf48012c60 tx=0x7fbf4802c620 comp rx=0 tx=0).stop 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.508+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4196623167 shutdown_connections 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.508+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4196623167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58106650 0x7fbf44005580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.508+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4196623167 >> 172.21.15.184:0/4196623167 conn(0x7fbf580fc280 msgr2=0x7fbf580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.508+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4196623167 shutdown_connections 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.509+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4196623167 wait complete. 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.509+0000 7fbf5fe6c640 1 Processor -- start 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.509+0000 7fbf5fe6c640 1 -- start start 2024-09-19T08:54:20.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5fe6c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5fe6c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58198460 0x7fbf581988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5fe6c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbf58108540 con 0x7fbf58198460 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5fe6c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbf581083c0 con 0x7fbf58106650 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:35758/0 (socket says 172.21.15.184:35758) 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 -- 172.21.15.184:0/4172428620 learned_addr learned my addr 172.21.15.184:0/4172428620 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 -- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 msgr2=0x7fbf58197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 -- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 msgr2=0x7fbf58197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5dc08640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.510+0000 7fbf5d407640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58198460 0x7fbf581988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf5d407640 1 -- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 msgr2=0x7fbf58197f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:20.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf5d407640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf5d407640 1 -- 172.21.15.184:0/4172428620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf581a0f90 con 0x7fbf58198460 2024-09-19T08:54:20.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf5d407640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58198460 0x7fbf581988c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b3d0 tx=0x7fbf5400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:20.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbf54011630 con 0x7fbf58198460 2024-09-19T08:54:20.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf54011c80 con 0x7fbf58198460 2024-09-19T08:54:20.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbf54010d80 con 0x7fbf58198460 2024-09-19T08:54:20.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf581a1160 con 0x7fbf58198460 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.511+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf581a16f0 con 0x7fbf58198460 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.512+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbf54018020 con 0x7fbf58198460 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.512+0000 7fbf4effd640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbf3c039090 0x7fbf3c03b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.512+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbf5404bf90 con 0x7fbf58198460 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.512+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf58101cc0 con 0x7fbf58198460 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.512+0000 7fbf5dc08640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbf3c039090 0x7fbf3c03b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.513+0000 7fbf5dc08640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbf3c039090 0x7fbf3c03b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf48012aa0 tx=0x7fbf48005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:20.517 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.517+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf5401f020 con 0x7fbf58198460 2024-09-19T08:54:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: mon.a calling monitor election 2024-09-19T08:54:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: mon.c calling monitor election 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: monmap epoch 2 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: last_changed 2024-09-19T08:54:15.369657+0000 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: min_mon_release 19 (squid) 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: election_strategy: 1 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:20.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: fsmap 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: mgrmap e13: x(active, since 37s) 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: overall HEALTH_OK 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:20.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:20.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.752+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbf5818fc20 con 0x7fbf58198460 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: mon.a calling monitor election 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: mon.c calling monitor election 2024-09-19T08:54:20.752 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: monmap epoch 2 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: last_changed 2024-09-19T08:54:15.369657+0000 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: min_mon_release 19 (squid) 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: election_strategy: 1 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: fsmap 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: mgrmap e13: x(active, since 37s) 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: overall HEALTH_OK 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:20.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:20.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.752+0000 7fbf4effd640 1 -- 172.21.15.184:0/4172428620 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fbf54014170 con 0x7fbf58198460 2024-09-19T08:54:20.755 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:54:20.755 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:54:15.369657Z","created":"2024-09-19T08:52:47.071352Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:54:20.755 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbf3c039090 msgr2=0x7fbf3c03b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbf3c039090 0x7fbf3c03b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf48012aa0 tx=0x7fbf48005dc0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58198460 msgr2=0x7fbf581988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58198460 0x7fbf581988c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b3d0 tx=0x7fbf5400b890 comp rx=0 tx=0).stop 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 shutdown_connections 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbf3c039090 0x7fbf3c03b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf58198460 0x7fbf581988c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 --2- 172.21.15.184:0/4172428620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf58106650 0x7fbf58197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 >> 172.21.15.184:0/4172428620 conn(0x7fbf580fc280 msgr2=0x7fbf580fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 shutdown_connections 2024-09-19T08:54:20.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:20.755+0000 7fbf5fe6c640 1 -- 172.21.15.184:0/4172428620 wait complete. 2024-09-19T08:54:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:21 smithi184 ceph-mon[35007]: Deploying daemon mon.b on smithi122 2024-09-19T08:54:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:21 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/4172428620' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:21 smithi184 ceph-mon[35007]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:21 smithi083 ceph-mon[30926]: Deploying daemon mon.b on smithi122 2024-09-19T08:54:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:21 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/4172428620' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:21 smithi083 ceph-mon[30926]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:22.338 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:54:22.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:22.588 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 -- 172.21.15.184:0/69913028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8107660 msgr2=0x7f82e8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 --2- 172.21.15.184:0/69913028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8107660 0x7f82e8107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009880 tx=0x7f82d802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 -- 172.21.15.184:0/69913028 shutdown_connections 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 --2- 172.21.15.184:0/69913028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8107660 0x7f82e8107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 -- 172.21.15.184:0/69913028 >> 172.21.15.184:0/69913028 conn(0x7f82e80fd320 msgr2=0x7f82e80ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 -- 172.21.15.184:0/69913028 shutdown_connections 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.077+0000 7f82eea58640 1 -- 172.21.15.184:0/69913028 wait complete. 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82eea58640 1 Processor -- start 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82eea58640 1 -- start start 2024-09-19T08:54:23.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82eea58640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82eea58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8197780 0x7f82e819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82eea58640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f82e810bbd0 con 0x7f82e8197780 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82eea58640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f82e810ba50 con 0x7f82e8107660 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:35766/0 (socket says 172.21.15.184:35766) 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 -- 172.21.15.184:0/626990189 learned_addr learned my addr 172.21.15.184:0/626990189 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 -- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 msgr2=0x7f82e8197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 -- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 msgr2=0x7f82e8197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e7fff640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.078+0000 7f82e77fe640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8197780 0x7f82e819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e77fe640 1 -- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 msgr2=0x7f82e8197240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e77fe640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e77fe640 1 -- 172.21.15.184:0/626990189 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e8197da0 con 0x7f82e8197780 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e77fe640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8197780 0x7f82e819bb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00b3d0 tx=0x7f82dc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f82dc011630 con 0x7f82e8197780 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82dc011c80 con 0x7f82e8197780 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e819c050 con 0x7f82e8197780 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f82dc010d80 con 0x7f82e8197780 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.079+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e819c590 con 0x7f82e8197780 2024-09-19T08:54:23.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.080+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f82dc018020 con 0x7f82e8197780 2024-09-19T08:54:23.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.080+0000 7f82e57fa640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82d0039090 0x7f82d003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.080+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e8102da0 con 0x7f82e8197780 2024-09-19T08:54:23.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.080+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f82dc04bf60 con 0x7f82e8197780 2024-09-19T08:54:23.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.081+0000 7f82e7fff640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82d0039090 0x7f82d003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.081+0000 7f82e7fff640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82d0039090 0x7f82d003b550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f82d802abc0 tx=0x7f82d802aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:23.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.086+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82dc01f020 con 0x7f82e8197780 2024-09-19T08:54:23.314 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.314+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f82e819c8a0 con 0x7f82e8197780 2024-09-19T08:54:23.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.315+0000 7f82e57fa640 1 -- 172.21.15.184:0/626990189 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f82dc014170 con 0x7f82e8197780 2024-09-19T08:54:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:54:23.315 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:54:15.369657Z","created":"2024-09-19T08:52:47.071352Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:54:23.315 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82d0039090 msgr2=0x7f82d003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82d0039090 0x7f82d003b550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f82d802abc0 tx=0x7f82d802aad0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8197780 msgr2=0x7f82e819bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8197780 0x7f82e819bb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00b3d0 tx=0x7f82dc00b890 comp rx=0 tx=0).stop 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 shutdown_connections 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82d0039090 0x7f82d003b550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82e8197780 0x7f82e819bb10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.318 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 --2- 172.21.15.184:0/626990189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82e8107660 0x7f82e8197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.318 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 >> 172.21.15.184:0/626990189 conn(0x7f82e80fd320 msgr2=0x7f82e80fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.318 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 shutdown_connections 2024-09-19T08:54:23.318 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:23.317+0000 7f82eea58640 1 -- 172.21.15.184:0/626990189 wait complete. 2024-09-19T08:54:24.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:23 smithi184 ceph-mon[35007]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:24.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:23 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/626990189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:23 smithi083 ceph-mon[30926]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:23 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/626990189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:24.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:24 smithi122 systemd[1]: Started Ceph mon.b for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:54:24.878 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:54:24.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:25.129 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:54:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: mon.c calling monitor election 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: mon.a calling monitor election 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: monmap epoch 3 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: last_changed 2024-09-19T08:54:24.289300+0000 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: min_mon_release 19 (squid) 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: election_strategy: 1 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:29.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: 2: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: fsmap 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: mgrmap e13: x(active, since 46s) 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: overall HEALTH_OK 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: mon.c calling monitor election 2024-09-19T08:54:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: mon.a calling monitor election 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:54:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: monmap epoch 3 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: last_changed 2024-09-19T08:54:24.289300+0000 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: min_mon_release 19 (squid) 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: election_strategy: 1 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: 2: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: fsmap 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: mgrmap e13: x(active, since 46s) 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: overall HEALTH_OK 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:29.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 -- 172.21.15.184:0/3090763303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc003530 msgr2=0x7fe4cc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3090763303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc003530 0x7fe4cc0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc102af0 tx=0x7fe4d002c490 comp rx=0 tx=0).stop 2024-09-19T08:54:29.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 -- 172.21.15.184:0/3090763303 shutdown_connections 2024-09-19T08:54:29.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3090763303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4cc003530 0x7fe4cc0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 -- 172.21.15.184:0/3090763303 >> 172.21.15.184:0/3090763303 conn(0x7fe4dc0fd320 msgr2=0x7fe4dc0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 -- 172.21.15.184:0/3090763303 shutdown_connections 2024-09-19T08:54:29.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.952+0000 7fe4e3083640 1 -- 172.21.15.184:0/3090763303 wait complete. 2024-09-19T08:54:29.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 Processor -- start 2024-09-19T08:54:29.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 -- start start 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 0x7fe4dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4dc074a30 0x7fe4dc074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1095d0 con 0x7fe4dc074a30 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc109450 con 0x7fe4cc003530 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e3083640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc109750 con 0x7fe4dc1a34d0 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42216/0 (socket says 172.21.15.184:42216) 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 -- 172.21.15.184:0/3098202043 learned_addr learned my addr 172.21.15.184:0/3098202043 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:54:29.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 msgr2=0x7fe4dc1a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 msgr2=0x7fe4dc1a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4dbfff640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4dc074a30 0x7fe4dc074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e1620640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.953+0000 7fe4e0e1f640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 0x7fe4dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4e0e1f640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 msgr2=0x7fe4dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4e0e1f640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 msgr2=0x7fe4dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4e0e1f640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 0x7fe4dc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4e0e1f640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 0x7fe4dc0744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4dbfff640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 msgr2=0x7fe4dc1a58c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4dbfff640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4dbfff640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 msgr2=0x7fe4dc0744f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4dbfff640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 0x7fe4dc0744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4dbfff640 1 -- 172.21.15.184:0/3098202043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc1a5f90 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4dbfff640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4dc074a30 0x7fe4dc074e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b450 tx=0x7fe4c800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8004230 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc1a6280 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4c80043d0 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8003be0 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.954+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc1a6810 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.955+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe4c800f050 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.956+0000 7fe4d9ffb640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4c0039730 0x7fe4c003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.956+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4dc10a700 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.956+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe4c804c060 con 0x7fe4dc074a30 2024-09-19T08:54:29.958 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.956+0000 7fe4e0e1f640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4c0039730 0x7fe4c003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.959 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.956+0000 7fe4e0e1f640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4c0039730 0x7fe4c003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005dc0 tx=0x7fe4d0005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.960 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:29.961+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4c800d040 con 0x7fe4dc074a30 2024-09-19T08:54:30.199 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.199+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe4dc190d30 con 0x7fe4dc074a30 2024-09-19T08:54:30.199 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.200+0000 7fe4d9ffb640 1 -- 172.21.15.184:0/3098202043 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fe4c800f5a0 con 0x7fe4dc074a30 2024-09-19T08:54:30.200 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:54:30.200 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":3,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:54:24.289300Z","created":"2024-09-19T08:52:47.071352Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:54:30.200 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 3 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4c0039730 msgr2=0x7fe4c003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4c0039730 0x7fe4c003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005dc0 tx=0x7fe4d0005d10 comp rx=0 tx=0).stop 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4dc074a30 msgr2=0x7fe4dc074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4dc074a30 0x7fe4dc074e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b450 tx=0x7fe4c800b910 comp rx=0 tx=0).stop 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 shutdown_connections 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe4c0039730 0x7fe4c003bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4dc1a34d0 0x7fe4dc1a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4dc074a30 0x7fe4dc074e90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 --2- 172.21.15.184:0/3098202043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4cc003530 0x7fe4dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 >> 172.21.15.184:0/3098202043 conn(0x7fe4dc0fd320 msgr2=0x7fe4dc1069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.202 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 shutdown_connections 2024-09-19T08:54:30.203 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:30.202+0000 7fe4e3083640 1 -- 172.21.15.184:0/3098202043 wait complete. 2024-09-19T08:54:30.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:30.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:30 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/3098202043' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:30.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:30.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:30.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:30 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/3098202043' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:30.779 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:54:30.779 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:54:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 -- 172.21.15.83:0/2311258313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4107650 msgr2=0x7f57b4107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 --2- 172.21.15.83:0/2311258313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4107650 0x7f57b4107a30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009880 tx=0x7f57a402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 -- 172.21.15.83:0/2311258313 shutdown_connections 2024-09-19T08:54:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 --2- 172.21.15.83:0/2311258313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4107650 0x7f57b4107a30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 -- 172.21.15.83:0/2311258313 >> 172.21.15.83:0/2311258313 conn(0x7f57b40fd2a0 msgr2=0x7f57b40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 -- 172.21.15.83:0/2311258313 shutdown_connections 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 -- 172.21.15.83:0/2311258313 wait complete. 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 Processor -- start 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.589+0000 7f57ba75b640 1 -- start start 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57ba75b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57b4107650 0x7f57b4197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57ba75b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b41977b0 0x7f57b419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57ba75b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 0x7f57b419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57ba75b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410bac0 con 0x7f57b419c080 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57ba75b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410b940 con 0x7f57b4107650 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57ba75b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410bc40 con 0x7f57b41977b0 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 0x7f57b419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 0x7f57b419c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59826/0 (socket says 172.21.15.83:59826) 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 -- 172.21.15.83:0/1582012607 learned_addr learned my addr 172.21.15.83:0/1582012607 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b3fff640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57b4107650 0x7f57b4197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b37fe640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b41977b0 0x7f57b419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 -- 172.21.15.83:0/1582012607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b41977b0 msgr2=0x7f57b419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b41977b0 0x7f57b419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 -- 172.21.15.83:0/1582012607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57b4107650 msgr2=0x7f57b4197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.590+0000 7f57b8cf8640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57b4107650 0x7f57b4197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57b8cf8640 1 -- 172.21.15.83:0/1582012607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b41a3df0 con 0x7f57b419c080 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57b8cf8640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 0x7f57b419c530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00ba50 tx=0x7f57ac00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac019070 con 0x7f57b419c080 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b4074480 con 0x7f57b419c080 2024-09-19T08:54:31.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57ac00cbe0 con 0x7f57b419c080 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0075d0 con 0x7f57b419c080 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.591+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b40749f0 con 0x7f57b419c080 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.592+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f57ac01c070 con 0x7f57b419c080 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.592+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b4107ab0 con 0x7f57b419c080 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.593+0000 7f57b17fa640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f579c039730 0x7f579c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.593+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f57ac055840 con 0x7f57b419c080 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.593+0000 7f57b3fff640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f579c039730 0x7f579c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.593+0000 7f57b3fff640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f579c039730 0x7f579c03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f57a4031440 tx=0x7f57a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.598+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57ac017e30 con 0x7f57b419c080 2024-09-19T08:54:31.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: mon.c calling monitor election 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: mon.a calling monitor election 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: monmap epoch 3 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: last_changed 2024-09-19T08:54:24.289300+0000 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: min_mon_release 19 (squid) 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: election_strategy: 1 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: 2: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: fsmap 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:31.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: mgrmap e13: x(active, since 46s) 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: overall HEALTH_OK 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/3098202043' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:31.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.782+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f57b4074d80 con 0x7f57b419c080 2024-09-19T08:54:31.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.782+0000 7f57b17fa640 1 -- 172.21.15.83:0/1582012607 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f57ac00fe60 con 0x7f57b419c080 2024-09-19T08:54:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:# minimal ceph.conf for 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:31.783 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-09-19T08:54:31.783 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:31.783 INFO:teuthology.orchestra.run.smithi083.stdout: mon_host = [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-09-19T08:54:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.784+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f579c039730 msgr2=0x7f579c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.784+0000 7f57ba75b640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f579c039730 0x7f579c03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f57a4031440 tx=0x7f57a4005a20 comp rx=0 tx=0).stop 2024-09-19T08:54:31.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.784+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 msgr2=0x7f57b419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.784+0000 7f57ba75b640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 0x7f57b419c530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00ba50 tx=0x7f57ac00bf10 comp rx=0 tx=0).stop 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 shutdown_connections 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f579c039730 0x7f579c03bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b419c080 0x7f57b419c530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b41977b0 0x7f57b419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 --2- 172.21.15.83:0/1582012607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57b4107650 0x7f57b4197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 >> 172.21.15.83:0/1582012607 conn(0x7f57b40fd2a0 msgr2=0x7f57b41051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 shutdown_connections 2024-09-19T08:54:31.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:31.785+0000 7f57ba75b640 1 -- 172.21.15.83:0/1582012607 wait complete. 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: mon.b calling monitor election 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: mon.b calling monitor election 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: mon.c calling monitor election 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: mon.a calling monitor election 2024-09-19T08:54:32.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: monmap epoch 3 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: last_changed 2024-09-19T08:54:24.289300+0000 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: min_mon_release 19 (squid) 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: election_strategy: 1 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: 2: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-09-19T08:54:32.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: fsmap 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: mgrmap e13: x(active, since 48s) 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: overall HEALTH_OK 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: Reconfiguring daemon mon.a on smithi083 2024-09-19T08:54:32.389 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:32 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1582012607' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: mon.b calling monitor election 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: mon.b calling monitor election 2024-09-19T08:54:32.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: mon.c calling monitor election 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: mon.a calling monitor election 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: monmap epoch 3 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: last_changed 2024-09-19T08:54:24.289300+0000 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: min_mon_release 19 (squid) 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: election_strategy: 1 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:32.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: 2: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: fsmap 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: mgrmap e13: x(active, since 48s) 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: overall HEALTH_OK 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: Reconfiguring daemon mon.a on smithi083 2024-09-19T08:54:32.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:32 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1582012607' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:32.449 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:54:32.450 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:54:32.450 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:54:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: mon.b calling monitor election 2024-09-19T08:54:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T08:54:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T08:54:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T08:54:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: mon.b calling monitor election 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: mon.c calling monitor election 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: mon.a calling monitor election 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: monmap epoch 3 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: last_changed 2024-09-19T08:54:24.289300+0000 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: created 2024-09-19T08:52:47.071352+0000 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: min_mon_release 19 (squid) 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: election_strategy: 1 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-19T08:54:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: 2: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: fsmap 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: mgrmap e13: x(active, since 48s) 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: overall HEALTH_OK 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: Reconfiguring daemon mon.a on smithi083 2024-09-19T08:54:32.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:32 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1582012607' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:32.477 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:54:32.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:32.542 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:54:32.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:54:32.572 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:54:32.572 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:32.639 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:54:32.639 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:54:32.665 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:54:32.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:32.730 INFO:tasks.cephadm:Adding mgr.x on smithi083 2024-09-19T08:54:32.730 INFO:tasks.cephadm:Adding mgr.y on smithi122 2024-09-19T08:54:32.730 INFO:tasks.cephadm:Adding mgr.z on smithi184 2024-09-19T08:54:32.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi083=x;smithi122=y;smithi184=z' 2024-09-19T08:54:33.008 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:54:33.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:33.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:33 smithi184 ceph-mon[35007]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:33.388 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:33.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:33.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:33 smithi122 ceph-mon[34247]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:33.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:33.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:54:33.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:33 smithi083 ceph-mon[30926]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:33.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 -- 172.21.15.184:0/2725717353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78102180 msgr2=0x7f7c78104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/2725717353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78102180 0x7f7c78104570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009880 tx=0x7f7c6802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 -- 172.21.15.184:0/2725717353 shutdown_connections 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/2725717353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78102180 0x7f7c78104570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 -- 172.21.15.184:0/2725717353 >> 172.21.15.184:0/2725717353 conn(0x7f7c780fbda0 msgr2=0x7f7c780fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 -- 172.21.15.184:0/2725717353 shutdown_connections 2024-09-19T08:54:33.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.472+0000 7f7c7cb58640 1 -- 172.21.15.184:0/2725717353 wait complete. 2024-09-19T08:54:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 Processor -- start 2024-09-19T08:54:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 -- start start 2024-09-19T08:54:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c78102180 0x7f7c78196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 0x7f7c7819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78197830 0x7f7c7819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781075f0 con 0x7f7c78197830 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78107470 con 0x7f7c78102180 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7cb58640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78107770 con 0x7f7c781973b0 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c6dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 0x7f7c7819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c6dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 0x7f7c7819c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42228/0 (socket says 172.21.15.184:42228) 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c6dd9b640 1 -- 172.21.15.184:0/890131058 learned_addr learned my addr 172.21.15.184:0/890131058 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c76d9d640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78197830 0x7f7c7819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.473+0000 7f7c7659c640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c78102180 0x7f7c78196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6dd9b640 1 -- 172.21.15.184:0/890131058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c78102180 msgr2=0x7f7c78196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6dd9b640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c78102180 0x7f7c78196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6dd9b640 1 -- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78197830 msgr2=0x7f7c7819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6dd9b640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78197830 0x7f7c7819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6dd9b640 1 -- 172.21.15.184:0/890131058 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7819f270 con 0x7f7c781973b0 2024-09-19T08:54:33.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6dd9b640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 0x7f7c7819c420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000b520 tx=0x7f7c6000b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60004230 con 0x7f7c781973b0 2024-09-19T08:54:33.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c600043d0 con 0x7f7c781973b0 2024-09-19T08:54:33.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7819f560 con 0x7f7c781973b0 2024-09-19T08:54:33.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60003cf0 con 0x7f7c781973b0 2024-09-19T08:54:33.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.474+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7819fb20 con 0x7f7c781973b0 2024-09-19T08:54:33.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.475+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7c6000e070 con 0x7f7c781973b0 2024-09-19T08:54:33.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.475+0000 7f7c6ffff640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c64039730 0x7f7c6403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.475+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7c6004cd00 con 0x7f7c781973b0 2024-09-19T08:54:33.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.475+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c781903b0 con 0x7f7c781973b0 2024-09-19T08:54:33.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.475+0000 7f7c7659c640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c64039730 0x7f7c6403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.476+0000 7f7c7659c640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c64039730 0x7f7c6403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c6802abc0 tx=0x7f7c68031d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.480 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.480+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c60014020 con 0x7f7c781973b0 2024-09-19T08:54:33.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.657+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi122=y;smithi184=z", "target": ["mon-mgr", ""]}) -- 0x7f7c780626c0 con 0x7f7c64039730 2024-09-19T08:54:33.664 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.664+0000 7f7c6ffff640 1 -- 172.21.15.184:0/890131058 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7c780626c0 con 0x7f7c64039730 2024-09-19T08:54:33.664 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mgr update... 2024-09-19T08:54:33.666 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c64039730 msgr2=0x7f7c6403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.666 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c64039730 0x7f7c6403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c6802abc0 tx=0x7f7c68031d30 comp rx=0 tx=0).stop 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 msgr2=0x7f7c7819c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 0x7f7c7819c420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000b520 tx=0x7f7c6000b9e0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 shutdown_connections 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c64039730 0x7f7c6403bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78197830 0x7f7c7819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c781973b0 0x7f7c7819c420 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 --2- 172.21.15.184:0/890131058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c78102180 0x7f7c78196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.666+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 >> 172.21.15.184:0/890131058 conn(0x7f7c780fbda0 msgr2=0x7f7c780fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.667+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 shutdown_connections 2024-09-19T08:54:33.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:54:33.667+0000 7f7c7cb58640 1 -- 172.21.15.184:0/890131058 wait complete. 2024-09-19T08:54:34.263 DEBUG:teuthology.orchestra.run.smithi122:mgr.y> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:54:34.266 DEBUG:teuthology.orchestra.run.smithi184:mgr.z> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:54:34.268 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:54:34.269 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T08:54:34.269 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:54:34.287 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:54:34.288 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-09-19T08:54:34.344 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:54:34.344 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-19 08:53:51.662180783 +0000 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-19 08:49:49.583106220 +0000 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-19 08:49:49.583106220 +0000 2024-09-19T08:54:34.345 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-19 08:49:49.583106220 +0000 2024-09-19T08:54:34.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:54:34.411 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-19T08:54:34.411 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-19T08:54:34.411 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000224145 s, 2.3 MB/s 2024-09-19T08:54:34.412 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:54:34.470 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-19 08:53:51.693180049 +0000 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-19 08:49:49.925097894 +0000 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-19 08:49:49.925097894 +0000 2024-09-19T08:54:34.527 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-19 08:49:49.925097894 +0000 2024-09-19T08:54:34.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.00020708 s, 2.5 MB/s 2024-09-19T08:54:34.594 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:54:34.652 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-09-19T08:54:34.708 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:54:34.708 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:34.708 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T08:54:34.708 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:34.709 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:34.709 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-19 08:53:51.722179363 +0000 2024-09-19T08:54:34.709 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-19 08:49:50.255089861 +0000 2024-09-19T08:54:34.709 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-19 08:49:50.255089861 +0000 2024-09-19T08:54:34.709 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-19 08:49:50.255089861 +0000 2024-09-19T08:54:34.709 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:54:34.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:54:34.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:34.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:34.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:34.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: Reconfiguring daemon mon.b on smithi122 2024-09-19T08:54:34.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi122=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:34.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: Saving service mgr spec with placement smithi083=x;smithi122=y;smithi184=z;count:3 2024-09-19T08:54:34.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.734 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-19T08:54:34.735 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-19T08:54:34.735 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000214507 s, 2.4 MB/s 2024-09-19T08:54:34.736 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:54:34.793 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-19 08:53:51.751178677 +0000 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-19 08:49:50.568082241 +0000 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-19 08:49:50.568082241 +0000 2024-09-19T08:54:34.849 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-19 08:49:50.568082241 +0000 2024-09-19T08:54:34.849 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:54:34.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: Reconfiguring daemon mon.b on smithi122 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi122=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: Saving service mgr spec with placement smithi083=x;smithi122=y;smithi184=z;count:3 2024-09-19T08:54:34.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.913 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-19T08:54:34.913 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-19T08:54:34.913 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000182337 s, 2.8 MB/s 2024-09-19T08:54:34.914 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: Reconfiguring daemon mon.b on smithi122 2024-09-19T08:54:34.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi122=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:34.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: Saving service mgr spec with placement smithi083=x;smithi122=y;smithi184=z;count:3 2024-09-19T08:54:34.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:34.970 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-19T08:54:34.970 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:54:34.987 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:54:34.987 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-19 08:54:23.696422449 +0000 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-19 08:49:49.965781050 +0000 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-19 08:49:49.965781050 +0000 2024-09-19T08:54:35.043 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-19 08:49:49.965781050 +0000 2024-09-19T08:54:35.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:54:35.106 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-19T08:54:35.106 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-19T08:54:35.107 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000284752 s, 1.8 MB/s 2024-09-19T08:54:35.108 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:54:35.164 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-19 08:54:23.696422449 +0000 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-19 08:49:50.296773391 +0000 2024-09-19T08:54:35.219 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-19 08:49:50.296773391 +0000 2024-09-19T08:54:35.220 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-19 08:49:50.296773391 +0000 2024-09-19T08:54:35.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:54:35.282 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-19T08:54:35.282 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-19T08:54:35.282 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000203235 s, 2.5 MB/s 2024-09-19T08:54:35.283 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:54:35.339 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-19T08:54:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:54:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:35.394 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T08:54:35.395 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:35.395 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:35.395 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-19 08:54:23.696422449 +0000 2024-09-19T08:54:35.395 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-19 08:49:50.617765964 +0000 2024-09-19T08:54:35.395 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-19 08:49:50.617765964 +0000 2024-09-19T08:54:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-19 08:49:50.617765964 +0000 2024-09-19T08:54:35.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:54:35.457 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-19T08:54:35.457 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-19T08:54:35.457 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000187208 s, 2.7 MB/s 2024-09-19T08:54:35.458 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:54:35.514 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-19T08:54:35.569 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:54:35.569 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:35.569 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T08:54:35.569 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:35.569 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:35.570 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-19 08:54:23.697422426 +0000 2024-09-19T08:54:35.570 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-19 08:49:50.945758375 +0000 2024-09-19T08:54:35.570 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-19 08:49:50.945758375 +0000 2024-09-19T08:54:35.570 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-19 08:49:50.945758375 +0000 2024-09-19T08:54:35.570 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:54:35.632 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-19T08:54:35.632 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-19T08:54:35.632 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000187902 s, 2.7 MB/s 2024-09-19T08:54:35.633 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:54:35.689 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-19T08:54:35.689 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:54:35.706 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:54:35.706 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-19 08:54:14.807521526 +0000 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-19 08:49:50.323373777 +0000 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-19 08:49:50.323373777 +0000 2024-09-19T08:54:35.761 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-19 08:49:50.323373777 +0000 2024-09-19T08:54:35.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:54:35.825 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-19T08:54:35.825 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-19T08:54:35.826 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000240137 s, 2.1 MB/s 2024-09-19T08:54:35.827 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:54:35.883 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-09-19T08:54:35.938 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:54:35.938 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:35.938 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:54:35.938 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:35.938 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:35.938 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-19 08:54:14.807521526 +0000 2024-09-19T08:54:35.939 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-19 08:49:50.659366661 +0000 2024-09-19T08:54:35.939 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-19 08:49:50.659366661 +0000 2024-09-19T08:54:35.939 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-19 08:49:50.659366661 +0000 2024-09-19T08:54:35.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:35.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:35 smithi122 ceph-mon[34247]: Reconfiguring daemon mon.c on smithi184 2024-09-19T08:54:36.003 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-19T08:54:36.003 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-19T08:54:36.003 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000222335 s, 2.3 MB/s 2024-09-19T08:54:36.004 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:54:36.061 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-19 08:54:14.807521526 +0000 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-19 08:49:50.989359673 +0000 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-19 08:49:50.989359673 +0000 2024-09-19T08:54:36.117 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-19 08:49:50.989359673 +0000 2024-09-19T08:54:36.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:36.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:35 smithi184 ceph-mon[35007]: Reconfiguring daemon mon.c on smithi184 2024-09-19T08:54:36.172 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-19T08:54:36.172 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-19T08:54:36.172 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000216867 s, 2.4 MB/s 2024-09-19T08:54:36.173 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:35 smithi083 ceph-mon[30926]: Reconfiguring daemon mon.c on smithi184 2024-09-19T08:54:36.229 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-19 08:54:14.808521506 +0000 2024-09-19T08:54:36.285 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-19 08:49:51.310352875 +0000 2024-09-19T08:54:36.286 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-19 08:49:51.310352875 +0000 2024-09-19T08:54:36.286 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-19 08:49:51.310352875 +0000 2024-09-19T08:54:36.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:54:36.353 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-19T08:54:36.353 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-19T08:54:36.353 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000210488 s, 2.4 MB/s 2024-09-19T08:54:36.354 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:54:36.410 INFO:tasks.cephadm:Deploying osd.0 on smithi083 with /dev/vg_nvme/lv_4... 2024-09-19T08:54:36.411 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:54:36.661 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:37.346 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.346 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:37.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: Deploying daemon mgr.z on smithi184 2024-09-19T08:54:37.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:37 smithi184 ceph-mon[35007]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: Deploying daemon mgr.z on smithi184 2024-09-19T08:54:37.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:37 smithi122 ceph-mon[34247]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: Deploying daemon mgr.z on smithi184 2024-09-19T08:54:37.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:37 smithi083 ceph-mon[30926]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:38.399 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:38 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:38.304+0000 7f5a9e6f8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:38.802 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:38 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:38.452+0000 7f5a9e6f8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:54:38.802 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:38 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:38.517+0000 7f5a9e6f8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:54:38.803 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:38 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:38.664+0000 7f5a9e6f8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:38.803 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:38 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:38.802+0000 7f5a9e6f8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:54:39.139 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:54:39.166 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_4 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: Deploying daemon mgr.y on smithi122 2024-09-19T08:54:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-mon[35007]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:39.400 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:39.114+0000 7f5a9e6f8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:54:39.400 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:39.174+0000 7f5a9e6f8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:54:39.400 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:39 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:39.360+0000 7f5a9e6f8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:54:39.410 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:39.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: Deploying daemon mgr.y on smithi122 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:39 smithi122 ceph-mon[34247]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:39.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:39.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:54:39.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:39.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:39.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: Deploying daemon mgr.y on smithi122 2024-09-19T08:54:39.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:39 smithi083 ceph-mon[30926]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:39.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 -- 172.21.15.83:0/564721003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 msgr2=0x7f0570102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 --2- 172.21.15.83:0/564721003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f0570102190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f055c009900 tx=0x7f055c02a410 comp rx=0 tx=0).stop 2024-09-19T08:54:39.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 -- 172.21.15.83:0/564721003 shutdown_connections 2024-09-19T08:54:39.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 --2- 172.21.15.83:0/564721003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05701026d0 0x7f0570108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 --2- 172.21.15.83:0/564721003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f0570102190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 --2- 172.21.15.83:0/564721003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570100b10 0x7f0570100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 -- 172.21.15.83:0/564721003 >> 172.21.15.83:0/564721003 conn(0x7f05700fc2a0 msgr2=0x7f05700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 -- 172.21.15.83:0/564721003 shutdown_connections 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.871+0000 7f0576cf7640 1 -- 172.21.15.83:0/564721003 wait complete. 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 Processor -- start 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 -- start start 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570100b10 0x7f0570196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f05701972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05701026d0 0x7f057019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f057010c6c0 con 0x7f0570101d10 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f057010c540 con 0x7f05701026d0 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0576cf7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f057010c840 con 0x7f0570100b10 2024-09-19T08:54:39.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f05701972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0574a93640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570100b10 0x7f0570196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f05701972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59832/0 (socket says 172.21.15.83:59832) 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 -- 172.21.15.83:0/3178997158 learned_addr learned my addr 172.21.15.83:0/3178997158 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f0575294640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05701026d0 0x7f057019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 -- 172.21.15.83:0/3178997158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570100b10 msgr2=0x7f0570196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570100b10 0x7f0570196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 -- 172.21.15.83:0/3178997158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05701026d0 msgr2=0x7f057019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05701026d0 0x7f057019e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.872+0000 7f056ffff640 1 -- 172.21.15.83:0/3178997158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057019e9d0 con 0x7f0570101d10 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.873+0000 7f056ffff640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f05701972e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f055c004770 tx=0x7f055c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.873+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c03f030 con 0x7f0570101d10 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.873+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f055c003cb0 con 0x7f0570101d10 2024-09-19T08:54:39.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.873+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057019ec60 con 0x7f0570101d10 2024-09-19T08:54:39.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.873+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c035070 con 0x7f0570101d10 2024-09-19T08:54:39.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.873+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057019f140 con 0x7f0570101d10 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.874+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f055c042030 con 0x7f0570101d10 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.874+0000 7f056dffb640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0560039500 0x7f056003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.874+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f055c06cce0 con 0x7f0570101d10 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.874+0000 7f0574a93640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0560039500 0x7f056003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.874+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0570107f50 con 0x7f0570101d10 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.874+0000 7f0574a93640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0560039500 0x7f056003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0564005fd0 tx=0x7f056400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:39.879+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f055c0309f0 con 0x7f0570101d10 2024-09-19T08:54:40.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:40.055+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0570062630 con 0x7f0560039500 2024-09-19T08:54:40.454 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:54:40.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:54:40.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:40.590 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:54:40.590 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:54:40.590 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:40.590 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:40.590+0000 7f81a1227040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:40.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:54:40.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:54:40.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:40.649 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:40 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:40.239+0000 7f5a9e6f8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:54:40.649 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:40 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:40.309+0000 7f5a9e6f8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:54:40.960 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:40.746+0000 7f81a1227040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:54:40.960 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:40.814+0000 7f81a1227040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:54:41.250 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:40 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:40.972+0000 7f81a1227040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:41.250 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:41.125+0000 7f81a1227040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:54:41.337 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.075+0000 7f5a9e6f8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:54:41.337 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.190+0000 7f5a9e6f8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:54:41.337 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.335+0000 7f5a9e6f8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:41.510 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:41.448+0000 7f81a1227040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:54:41.510 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:41.510+0000 7f81a1227040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:41.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-mon[35007]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:41.626 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.401+0000 7f5a9e6f8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:54:41.626 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.555+0000 7f5a9e6f8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:54:41.626 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.624+0000 7f5a9e6f8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:54:41.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:41.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:41.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:41 smithi083 ceph-mon[30926]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:41.899 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.684+0000 7f5a9e6f8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:54:41.899 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.855+0000 7f5a9e6f8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:54:41.960 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:41.700+0000 7f81a1227040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:41 smithi122 ceph-mon[34247]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:42.189 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.921+0000 7f5a9e6f8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:54:42.189 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:41 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:41.990+0000 7f5a9e6f8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:54:42.189 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:42.072+0000 7f5a9e6f8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:42.189 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:42.131+0000 7f5a9e6f8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:54:42.189 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:42.189+0000 7f5a9e6f8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:54:42.960 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:42.581+0000 7f81a1227040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:54:42.960 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:42.647+0000 7f81a1227040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:54:42.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: Reconfiguring daemon mgr.x on smithi083 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3859153579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d0c1021-57d7-471d-830e-751d6c8d2375"}]: dispatch 2024-09-19T08:54:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3859153579' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d0c1021-57d7-471d-830e-751d6c8d2375"}]': finished 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: Reconfiguring daemon mgr.x on smithi083 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3859153579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d0c1021-57d7-471d-830e-751d6c8d2375"}]: dispatch 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3859153579' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d0c1021-57d7-471d-830e-751d6c8d2375"}]': finished 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:54:42.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:54:43.149 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T08:54:42.978+0000 7f5a9e6f8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:54:43.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:43.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:43.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:43.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:43.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: Reconfiguring daemon mgr.x on smithi083 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3859153579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d0c1021-57d7-471d-830e-751d6c8d2375"}]: dispatch 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3859153579' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d0c1021-57d7-471d-830e-751d6c8d2375"}]': finished 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:54:43.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:54:43.611 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.357+0000 7f81a1227040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:54:43.611 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.471+0000 7f81a1227040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:54:43.612 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.611+0000 7f81a1227040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:43.879 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.671+0000 7f81a1227040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:54:43.880 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.819+0000 7f81a1227040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:54:43.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:43.886+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f055c0438e0 con 0x7f0570101d10 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: Standby manager daemon z started 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:54:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:54:44.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:43 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/917634667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:54:44.166 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.887+0000 7f81a1227040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:54:44.166 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:43.946+0000 7f81a1227040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:44.101+0000 7f81a1227040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:44.166+0000 7f81a1227040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: Standby manager daemon z started 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:54:44.167 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:43 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/917634667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: Standby manager daemon z started 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2938133833' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:43 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/917634667' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:54:44.431 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:44.231+0000 7f81a1227040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:54:44.431 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:44.313+0000 7f81a1227040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:44.432 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:44.372+0000 7f81a1227040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:54:44.432 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:44.431+0000 7f81a1227040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:54:45.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:44 smithi184 ceph-mon[35007]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T08:54:45.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:54:45.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-mon[34247]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T08:54:45.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:54:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:44 smithi083 ceph-mon[30926]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T08:54:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:54:45.460 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T08:54:45.209+0000 7f81a1227040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:54:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:54:45.898+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f055c0433c0 con 0x7f0570101d10 2024-09-19T08:54:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-mon[34247]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-mon[34247]: Standby manager daemon y started 2024-09-19T08:54:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:54:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:45 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:45 smithi083 ceph-mon[30926]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:45 smithi083 ceph-mon[30926]: Standby manager daemon y started 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:45 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:45 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:45 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:54:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:45 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:54:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:45 smithi184 ceph-mon[35007]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:45 smithi184 ceph-mon[35007]: Standby manager daemon y started 2024-09-19T08:54:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:45 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:54:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:45 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:54:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:45 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:54:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:45 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/3823648231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:54:47.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:46 smithi122 ceph-mon[34247]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T08:54:47.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:54:47.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:46 smithi083 ceph-mon[30926]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T08:54:47.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:54:47.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:46 smithi184 ceph-mon[35007]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T08:54:47.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:54:47.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:47 smithi083 ceph-mon[30926]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:48.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:47 smithi122 ceph-mon[34247]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:47 smithi184 ceph-mon[35007]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:49 smithi122 ceph-mon[34247]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:50.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:50.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:49 smithi083 ceph-mon[30926]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:49 smithi184 ceph-mon[35007]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:51.174 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:50 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:51.175 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:50 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:51.175 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:50 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:51.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:50 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:51.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:50 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:51.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:50 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:51.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:50 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:51.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:50 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:51.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:50 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:52.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:51 smithi122 ceph-mon[34247]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:52.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:51 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:54:52.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:51 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:51 smithi083 ceph-mon[30926]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:51 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:54:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:51 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:52.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:51 smithi184 ceph-mon[35007]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:52.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:51 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:54:52.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:51 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:53.108 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:52 smithi083 ceph-mon[30926]: Deploying daemon osd.0 on smithi083 2024-09-19T08:54:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:52 smithi122 ceph-mon[34247]: Deploying daemon osd.0 on smithi083 2024-09-19T08:54:53.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:52 smithi184 ceph-mon[35007]: Deploying daemon osd.0 on smithi083 2024-09-19T08:54:54.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:53 smithi083 ceph-mon[30926]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:53 smithi122 ceph-mon[34247]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:53 smithi184 ceph-mon[35007]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:55 smithi122 ceph-mon[34247]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:56.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:55 smithi083 ceph-mon[30926]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:55 smithi184 ceph-mon[35007]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:57 smithi122 ceph-mon[34247]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:57 smithi083 ceph-mon[30926]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:57 smithi184 ceph-mon[35007]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:58.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:58.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:58.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:59.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:59.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:59.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:54:59.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:54:59 smithi083 ceph-mon[30926]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:00.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:54:59 smithi122 ceph-mon[34247]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:54:59 smithi184 ceph-mon[35007]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:01.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:01 smithi184 ceph-mon[35007]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:01.927 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.927 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.927 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:01.928 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:01.928 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.928 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:01 smithi083 ceph-mon[30926]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:01.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:01.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:01.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:01.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:01 smithi122 ceph-mon[34247]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:01.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.967+0000 7f056dffb640 1 -- 172.21.15.83:0/3178997158 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0570062630 con 0x7f0560039500 2024-09-19T08:55:01.967 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 0 on host 'smithi083' 2024-09-19T08:55:01.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0560039500 msgr2=0x7f056003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:01.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0560039500 0x7f056003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0564005fd0 tx=0x7f056400b390 comp rx=0 tx=0).stop 2024-09-19T08:55:01.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 msgr2=0x7f05701972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:01.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f05701972e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f055c004770 tx=0x7f055c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 shutdown_connections 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0560039500 0x7f056003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05701026d0 0x7f057019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0570101d10 0x7f05701972e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 --2- 172.21.15.83:0/3178997158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570100b10 0x7f0570196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.969+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 >> 172.21.15.83:0/3178997158 conn(0x7f05700fc2a0 msgr2=0x7f0570105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.970+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 shutdown_connections 2024-09-19T08:55:01.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:01.970+0000 7f0576cf7640 1 -- 172.21.15.83:0/3178997158 wait complete. 2024-09-19T08:55:02.584 DEBUG:teuthology.orchestra.run.smithi083:osd.0> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:55:02.586 INFO:tasks.cephadm:Deploying osd.1 on smithi122 with /dev/vg_nvme/lv_4... 2024-09-19T08:55:02.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:55:02.816 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:02 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:02.816 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:02 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:02.816 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:02 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:55:02.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:02 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:02.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:02 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:02.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:02 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:02.948 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:02 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:02.948 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:02 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:02.948 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:02 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:03.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:03 smithi184 ceph-mon[35007]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:03.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:03 smithi122 ceph-mon[34247]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:03.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:03 smithi083 ceph-mon[30926]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:04.334 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0[42263]: 2024-09-19T08:55:03.983+0000 7f07748e2640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:55:04.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:04 smithi184 ceph-mon[35007]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:55:04.925 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:04 smithi083 ceph-mon[30926]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:55:04.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:04 smithi122 ceph-mon[34247]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:55:05.105 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:55:05.129 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2024-09-19T08:55:05.389 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:55:05.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:55:05.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:05.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 -- 172.21.15.122:0/1850358885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0102690 msgr2=0x7feaa0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 --2- 172.21.15.122:0/1850358885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0102690 0x7feaa0108f20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea98009900 tx=0x7fea9802a410 comp rx=0 tx=0).stop 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 -- 172.21.15.122:0/1850358885 shutdown_connections 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 --2- 172.21.15.122:0/1850358885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0102690 0x7feaa0108f20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 --2- 172.21.15.122:0/1850358885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 0x7feaa0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 --2- 172.21.15.122:0/1850358885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0100ad0 0x7feaa0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 -- 172.21.15.122:0/1850358885 >> 172.21.15.122:0/1850358885 conn(0x7feaa00fc280 msgr2=0x7feaa00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 -- 172.21.15.122:0/1850358885 shutdown_connections 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 -- 172.21.15.122:0/1850358885 wait complete. 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 Processor -- start 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.866+0000 7feaa8733640 1 -- start start 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa8733640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 0x7feaa0197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa8733640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 0x7feaa0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa8733640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0102690 0x7feaa019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa8733640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010c660 con 0x7feaa0102690 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa8733640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010c4e0 con 0x7feaa0100ad0 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa8733640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010c7e0 con 0x7feaa0101cd0 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 0x7feaa0197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 0x7feaa0197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33750/0 (socket says 172.21.15.122:33750) 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 -- 172.21.15.122:0/2073732172 learned_addr learned my addr 172.21.15.122:0/2073732172 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa6cd0640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0102690 0x7feaa019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa5cce640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 0x7feaa0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 -- 172.21.15.122:0/2073732172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 msgr2=0x7feaa0198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 0x7feaa0198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 -- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0102690 msgr2=0x7feaa019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0102690 0x7feaa019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 -- 172.21.15.122:0/2073732172 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa019fa60 con 0x7feaa0100ad0 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa5cce640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 0x7feaa0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa6cd0640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0102690 0x7feaa019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7feaa64cf640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 0x7feaa0197e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea9000ebc0 tx=0x7fea9000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90003b70 con 0x7feaa0100ad0 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea90003d10 con 0x7feaa0100ad0 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.867+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90019840 con 0x7feaa0100ad0 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.868+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa019fd50 con 0x7feaa0100ad0 2024-09-19T08:55:05.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.868+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa01a0200 con 0x7feaa0100ad0 2024-09-19T08:55:05.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.869+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa01a04f0 con 0x7feaa0100ad0 2024-09-19T08:55:05.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.871+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fea90004b60 con 0x7feaa0100ad0 2024-09-19T08:55:05.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.871+0000 7fea9f7fe640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fea880a31e0 0x7fea880a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.871+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fea900ce700 con 0x7feaa0100ad0 2024-09-19T08:55:05.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.872+0000 7feaa5cce640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fea880a31e0 0x7fea880a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.872+0000 7feaa5cce640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fea880a31e0 0x7fea880a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feaa0199350 tx=0x7fea94008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:05.875+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea9009d040 con 0x7feaa0100ad0 2024-09-19T08:55:05.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:55:05.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:55:05.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:06.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:06.056+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7feaa006a6b0 con 0x7fea880a31e0 2024-09-19T08:55:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:55:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:55:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:55:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:06.669 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0[42263]: 2024-09-19T08:55:06.327+0000 7f0770865640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:55:06.669 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0[42263]: 2024-09-19T08:55:06.331+0000 7f0768685640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:55:06.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi083 2024-09-19T08:55:06.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' 2024-09-19T08:55:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi083 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' 2024-09-19T08:55:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi083 2024-09-19T08:55:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-19T08:55:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:55:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:55:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780]' entity='osd.0' 2024-09-19T08:55:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:07.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:55:07.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:55:07.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:07.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] boot 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:07 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] boot 2024-09-19T08:55:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:55:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:07 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: osd.0 [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] boot 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:55:08.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:07 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:08.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:08 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/4110972690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]: dispatch 2024-09-19T08:55:08.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:08 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]: dispatch 2024-09-19T08:55:08.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:08 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]': finished 2024-09-19T08:55:08.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:08 smithi122 ceph-mon[34247]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T08:55:08.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:08 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:08 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/4110972690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]: dispatch 2024-09-19T08:55:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:08 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]: dispatch 2024-09-19T08:55:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:08 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]': finished 2024-09-19T08:55:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:08 smithi083 ceph-mon[30926]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T08:55:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:08 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:09.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:08 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/4110972690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]: dispatch 2024-09-19T08:55:09.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:08 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]: dispatch 2024-09-19T08:55:09.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:08 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3a22d9c-ed3c-4f83-95cd-7801d8da969d"}]': finished 2024-09-19T08:55:09.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:08 smithi184 ceph-mon[35007]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T08:55:09.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:08 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:09.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:09 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/1850497650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:09.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:09 smithi122 ceph-mon[34247]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:09.960 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:09 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/1850497650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:09.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:09 smithi083 ceph-mon[30926]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:10.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:09 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/1850497650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:10.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:09 smithi184 ceph-mon[35007]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:12.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:11 smithi122 ceph-mon[34247]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:12.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:11 smithi083 ceph-mon[30926]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:11 smithi184 ceph-mon[35007]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:14.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:13 smithi122 ceph-mon[34247]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:13 smithi083 ceph-mon[30926]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:13 smithi184 ceph-mon[35007]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:15 smithi122 ceph-mon[34247]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:55:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:15 smithi083 ceph-mon[30926]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:55:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:15 smithi184 ceph-mon[35007]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:55:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:17.147 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:16 smithi122 ceph-mon[34247]: Deploying daemon osd.1 on smithi122 2024-09-19T08:55:17.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:16 smithi083 ceph-mon[30926]: Deploying daemon osd.1 on smithi122 2024-09-19T08:55:17.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:16 smithi184 ceph-mon[35007]: Deploying daemon osd.1 on smithi122 2024-09-19T08:55:18.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:17 smithi122 ceph-mon[34247]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:18.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:17 smithi083 ceph-mon[30926]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:17 smithi184 ceph-mon[35007]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:19 smithi122 ceph-mon[34247]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:19 smithi083 ceph-mon[30926]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:19 smithi184 ceph-mon[35007]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:22.201 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:21 smithi184 ceph-mon[35007]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:22.201 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:22.201 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:22.201 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:22.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:21 smithi122 ceph-mon[34247]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:22.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:21 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:22.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:21 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:22.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:21 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:21 smithi083 ceph-mon[30926]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:23 smithi122 ceph-mon[34247]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:23 smithi083 ceph-mon[30926]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:23 smithi184 ceph-mon[35007]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:25.613 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.613 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.614 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:25.614 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:25.614 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.614 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:25 smithi122 ceph-mon[34247]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:25 smithi083 ceph-mon[30926]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:25.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.869+0000 7fea9f7fe640 1 -- 172.21.15.122:0/2073732172 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feaa006a6b0 con 0x7fea880a31e0 2024-09-19T08:55:25.870 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 1 on host 'smithi122' 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.871+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fea880a31e0 msgr2=0x7fea880a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.871+0000 7feaa8733640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fea880a31e0 0x7fea880a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feaa0199350 tx=0x7fea94008040 comp rx=0 tx=0).stop 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.871+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 msgr2=0x7feaa0197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.871+0000 7feaa8733640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 0x7feaa0197e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea9000ebc0 tx=0x7fea9000c6a0 comp rx=0 tx=0).stop 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 shutdown_connections 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fea880a31e0 0x7fea880a56a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feaa0102690 0x7feaa019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:25.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0101cd0 0x7feaa0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:25.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 --2- 172.21.15.122:0/2073732172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feaa0100ad0 0x7feaa0197e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:25.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 >> 172.21.15.122:0/2073732172 conn(0x7feaa00fc280 msgr2=0x7feaa0069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:25.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 shutdown_connections 2024-09-19T08:55:25.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:55:25.872+0000 7feaa8733640 1 -- 172.21.15.122:0/2073732172 wait complete. 2024-09-19T08:55:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:25 smithi184 ceph-mon[35007]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:26.506 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:26 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:26.506 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:26 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:26.506 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:26 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:26.508 DEBUG:teuthology.orchestra.run.smithi122:osd.1> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:55:26.510 INFO:tasks.cephadm:Deploying osd.2 on smithi184 with /dev/vg_nvme/lv_4... 2024-09-19T08:55:26.510 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:55:26.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:26 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:26.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:26 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:26.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:26 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:26.763 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:26.885 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:26 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:26.885 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:26 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:26.885 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:26 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:27 smithi184 ceph-mon[35007]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:27.655 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:27 smithi122 ceph-mon[34247]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:27.656 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:27 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1[38686]: 2024-09-19T08:55:27.596+0000 7fa3b4b68640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:55:27.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:27 smithi083 ceph-mon[30926]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:28 smithi122 ceph-mon[34247]: from='osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:55:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:28 smithi122 ceph-mon[34247]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:55:28.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:28 smithi083 ceph-mon[30926]: from='osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:55:28.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:28 smithi083 ceph-mon[30926]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:55:28.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:28 smithi184 ceph-mon[35007]: from='osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:55:28.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:28 smithi184 ceph-mon[35007]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:55:29.203 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:55:29.230 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2024-09-19T08:55:29.480 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:55:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:55:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:55:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:55:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:29.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.713 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:55:29.713 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:55:29.713 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:55:29.713 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:29.713 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:29.714 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 -- 172.21.15.184:0/3787600027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088102690 msgr2=0x7ff088108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/3787600027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088102690 0x7ff088108f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff078009900 tx=0x7ff07802a410 comp rx=0 tx=0).stop 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 -- 172.21.15.184:0/3787600027 shutdown_connections 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/3787600027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088102690 0x7ff088108f20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/3787600027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088101cd0 0x7ff088102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/3787600027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088100ad0 0x7ff088100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 -- 172.21.15.184:0/3787600027 >> 172.21.15.184:0/3787600027 conn(0x7ff0880fc280 msgr2=0x7ff0880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 -- 172.21.15.184:0/3787600027 shutdown_connections 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.912+0000 7ff08c9ca640 1 -- 172.21.15.184:0/3787600027 wait complete. 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 Processor -- start 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 -- start start 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 0x7ff088104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088101cd0 0x7ff0881030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088102690 0x7ff0881035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff08810c600 con 0x7ff088101cd0 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff08810c480 con 0x7ff088102690 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08c9ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff08810c780 con 0x7ff088100ad0 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 0x7ff088104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 0x7ff088104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59814/0 (socket says 172.21.15.184:59814) 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 -- 172.21.15.184:0/795792189 learned_addr learned my addr 172.21.15.184:0/795792189 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:55:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff086d9d640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088102690 0x7ff0881035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff085d9b640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088101cd0 0x7ff0881030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 -- 172.21.15.184:0/795792189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088102690 msgr2=0x7ff0881035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088102690 0x7ff0881035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 -- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088101cd0 msgr2=0x7ff0881030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088101cd0 0x7ff0881030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.913+0000 7ff08659c640 1 -- 172.21.15.184:0/795792189 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088103eb0 con 0x7ff088100ad0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff086d9d640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088102690 0x7ff0881035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff085d9b640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088101cd0 0x7ff0881030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff08659c640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 0x7ff088104a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff08000ccb0 tx=0x7ff08000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080003990 con 0x7ff088100ad0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff080004020 con 0x7ff088100ad0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0881a1f40 con 0x7ff088100ad0 2024-09-19T08:55:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08000f6b0 con 0x7ff088100ad0 2024-09-19T08:55:29.917 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.914+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881a2390 con 0x7ff088100ad0 2024-09-19T08:55:29.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.915+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0881a2680 con 0x7ff088100ad0 2024-09-19T08:55:29.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.917+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7ff080003b30 con 0x7ff088100ad0 2024-09-19T08:55:29.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.917+0000 7ff07f7fe640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff0740a3230 0x7ff0740a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.917+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7ff0800ce290 con 0x7ff088100ad0 2024-09-19T08:55:29.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.918+0000 7ff085d9b640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff0740a3230 0x7ff0740a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.918+0000 7ff085d9b640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff0740a3230 0x7ff0740a56f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0881047e0 tx=0x7ff070005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:29.920 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:29.921+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff080014030 con 0x7ff088100ad0 2024-09-19T08:55:30.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:30.102+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff0881a2850 con 0x7ff0740a3230 2024-09-19T08:55:30.457 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1[38686]: 2024-09-19T08:55:30.118+0000 7fa3b0aeb640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:55:30.457 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1[38686]: 2024-09-19T08:55:30.122+0000 7fa3a890b640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:55:30.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi122 2024-09-19T08:55:30.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi122 to 17087M 2024-09-19T08:55:30.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:30 smithi184 ceph-mon[35007]: from='osd.1 ' entity='osd.1' 2024-09-19T08:55:30.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi122 2024-09-19T08:55:30.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi122 to 17087M 2024-09-19T08:55:30.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:55:30.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:55:30.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:30 smithi122 ceph-mon[34247]: from='osd.1 ' entity='osd.1' 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi122 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi122 to 17087M 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:55:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:55:30.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:30.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:30.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:30.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:30.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:30.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:30 smithi083 ceph-mon[30926]: from='osd.1 ' entity='osd.1' 2024-09-19T08:55:31.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:55:31.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:55:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] boot 2024-09-19T08:55:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T08:55:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:31.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:55:31.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:55:31.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:31.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] boot 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:55:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: osd.1 [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] boot 2024-09-19T08:55:31.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T08:55:31.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:55:32.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:32 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/2875731179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]: dispatch 2024-09-19T08:55:32.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:32 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]: dispatch 2024-09-19T08:55:32.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:32 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]': finished 2024-09-19T08:55:32.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:32 smithi184 ceph-mon[35007]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T08:55:32.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:32 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/2875731179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]: dispatch 2024-09-19T08:55:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:32 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]: dispatch 2024-09-19T08:55:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:32 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]': finished 2024-09-19T08:55:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:32 smithi122 ceph-mon[34247]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T08:55:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:32 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/2875731179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]: dispatch 2024-09-19T08:55:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:32 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]: dispatch 2024-09-19T08:55:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:32 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "886ac026-4d30-4180-af0e-945bc38124de"}]': finished 2024-09-19T08:55:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:32 smithi083 ceph-mon[30926]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T08:55:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:33.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:33 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/3113505290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:33.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:33 smithi184 ceph-mon[35007]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:33.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:33 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/3113505290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:33.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:33 smithi122 ceph-mon[34247]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:33 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/3113505290' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:33 smithi083 ceph-mon[30926]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:35 smithi122 ceph-mon[34247]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:35 smithi083 ceph-mon[30926]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:35 smithi184 ceph-mon[35007]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:38.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:37 smithi184 ceph-mon[35007]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:38.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:37 smithi122 ceph-mon[34247]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:38.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:37 smithi083 ceph-mon[30926]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:39.998 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:39 smithi184 ceph-mon[35007]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:40.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:39 smithi122 ceph-mon[34247]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:40.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:39 smithi083 ceph-mon[30926]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:40.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:55:40.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:41.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:55:41.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:41.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:55:41.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:42.098 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:41 smithi184 ceph-mon[35007]: Deploying daemon osd.2 on smithi184 2024-09-19T08:55:42.098 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:41 smithi184 ceph-mon[35007]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:42.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:41 smithi122 ceph-mon[34247]: Deploying daemon osd.2 on smithi184 2024-09-19T08:55:42.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:41 smithi122 ceph-mon[34247]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:42.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:41 smithi083 ceph-mon[30926]: Deploying daemon osd.2 on smithi184 2024-09-19T08:55:42.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:41 smithi083 ceph-mon[30926]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:44.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:43 smithi122 ceph-mon[34247]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:43 smithi083 ceph-mon[30926]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:43 smithi184 ceph-mon[35007]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:45.955 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:45 smithi184 ceph-mon[35007]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:45 smithi122 ceph-mon[34247]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:45 smithi083 ceph-mon[30926]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:47.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:47.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:47.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:47.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:47.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:47.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:47.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:47.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:47.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:48.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:47 smithi122 ceph-mon[34247]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:48.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:47 smithi083 ceph-mon[30926]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:48.310 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:47 smithi184 ceph-mon[35007]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:50.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:49 smithi184 ceph-mon[35007]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:50.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:50.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:50.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:49 smithi122 ceph-mon[34247]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:50.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:49 smithi083 ceph-mon[30926]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:50.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.777+0000 7ff07f7fe640 1 -- 172.21.15.184:0/795792189 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff0881a2850 con 0x7ff0740a3230 2024-09-19T08:55:50.777 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 2 on host 'smithi184' 2024-09-19T08:55:50.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff0740a3230 msgr2=0x7ff0740a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff0740a3230 0x7ff0740a56f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0881047e0 tx=0x7ff070005f90 comp rx=0 tx=0).stop 2024-09-19T08:55:50.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 msgr2=0x7ff088104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 0x7ff088104a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff08000ccb0 tx=0x7ff08000a620 comp rx=0 tx=0).stop 2024-09-19T08:55:50.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 shutdown_connections 2024-09-19T08:55:50.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff0740a3230 0x7ff0740a56f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff088102690 0x7ff0881035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff088101cd0 0x7ff0881030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 --2- 172.21.15.184:0/795792189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff088100ad0 0x7ff088104a60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 >> 172.21.15.184:0/795792189 conn(0x7ff0880fc280 msgr2=0x7ff088069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 shutdown_connections 2024-09-19T08:55:50.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:55:50.780+0000 7ff08c9ca640 1 -- 172.21.15.184:0/795792189 wait complete. 2024-09-19T08:55:51.095 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:50 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:51.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:50 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:51.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:50 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:51.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:50 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:51.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:50 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:51.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:50 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:51.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:50 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:51.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:50 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:51.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:50 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:51.398 DEBUG:teuthology.orchestra.run.smithi184:osd.2> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:55:51.400 INFO:tasks.cephadm:Deploying osd.3 on smithi083 with /dev/vg_nvme/lv_3... 2024-09-19T08:55:51.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:55:51.639 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:51.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:51 smithi184 ceph-mon[35007]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:52.089 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:51 smithi083 ceph-mon[30926]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:52.129 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:51 smithi122 ceph-mon[34247]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:52.399 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:52 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2[39964]: 2024-09-19T08:55:52.091+0000 7f214e904640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:55:53.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:52 smithi083 ceph-mon[30926]: from='osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:55:53.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:52 smithi083 ceph-mon[30926]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:55:53.131 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:52 smithi184 ceph-mon[35007]: from='osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:55:53.132 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:52 smithi184 ceph-mon[35007]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:55:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:52 smithi122 ceph-mon[34247]: from='osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:55:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:52 smithi122 ceph-mon[34247]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:55:54.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:53 smithi083 ceph-mon[30926]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:54.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:53 smithi083 ceph-mon[30926]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:55:54.125 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:53 smithi083 ceph-mon[30926]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:55:54.125 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:54.125 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:53 smithi083 ceph-mon[30926]: from='osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:55:54.125 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:53 smithi083 ceph-mon[30926]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:55:54.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:55:54.149 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2[39964]: 2024-09-19T08:55:53.897+0000 7f214a887640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:55:54.149 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2[39964]: 2024-09-19T08:55:53.900+0000 7f21466af640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:55:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-mon[35007]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-mon[35007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:55:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-mon[35007]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:55:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-mon[35007]: from='osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:55:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:53 smithi184 ceph-mon[35007]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:55:54.153 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_3 2024-09-19T08:55:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:53 smithi122 ceph-mon[34247]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:53 smithi122 ceph-mon[34247]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:55:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:53 smithi122 ceph-mon[34247]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:55:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:53 smithi122 ceph-mon[34247]: from='osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:55:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:53 smithi122 ceph-mon[34247]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:55:54.412 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:54.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 -- 172.21.15.83:0/1389007890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf0100690 msgr2=0x7f3cf0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/1389007890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf0100690 0x7f3cf0100b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009ca0 tx=0x7f3ce802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 -- 172.21.15.83:0/1389007890 shutdown_connections 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/1389007890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf0100690 0x7f3cf0100b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/1389007890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/1389007890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cf01021d0 0x7f3cf01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 -- 172.21.15.83:0/1389007890 >> 172.21.15.83:0/1389007890 conn(0x7f3cf00fba80 msgr2=0x7f3cf00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 -- 172.21.15.83:0/1389007890 shutdown_connections 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 -- 172.21.15.83:0/1389007890 wait complete. 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.874+0000 7f3cf87e6640 1 Processor -- start 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 -- start start 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cf0100690 0x7f3cf019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 0x7f3cf01a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf010f940 con 0x7f3cf01021d0 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf010f7c0 con 0x7f3cf0100690 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf87e6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf010fac0 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6d83640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 0x7f3cf01a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.83:56224/0 (socket says 172.21.15.83:56224) 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6d83640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 0x7f3cf01a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58388/0 (socket says 172.21.15.83:58388) 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 -- 172.21.15.83:0/3075248311 learned_addr learned my addr 172.21.15.83:0/3075248311 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf5d81640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cf0100690 0x7f3cf019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 -- 172.21.15.83:0/3075248311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cf0100690 msgr2=0x7f3cf019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cf0100690 0x7f3cf019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 -- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 msgr2=0x7f3cf01a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 0x7f3cf01a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 -- 172.21.15.83:0/3075248311 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf01a1c70 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6d83640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 0x7f3cf01a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.875+0000 7f3cf6582640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf019a040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00d950 tx=0x7f3cec00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.876+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec017070 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.876+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3cec009c30 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.876+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf01a1f60 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.876+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00f620 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.876+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf01a23c0 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.877+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf010baf0 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.878+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f3cec0109a0 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.878+0000 7f3ce77fe640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3cdc0a31e0 0x7f3cdc0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.878+0000 7f3cf5d81640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3cdc0a31e0 0x7f3cdc0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.879+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2571+0+0 (secure 0 0 0) 0x7f3cec0cdd40 con 0x7f3cf00ffcd0 2024-09-19T08:55:54.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.879+0000 7f3cf5d81640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3cdc0a31e0 0x7f3cdc0a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3cf019b560 tx=0x7f3ce0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:54.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:54.882+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cec09bac0 con 0x7f3cf00ffcd0 2024-09-19T08:55:55.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:55:55.067+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3cf0062630 con 0x7f3cdc0a31e0 2024-09-19T08:55:55.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:55:55.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:55:55.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:55.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:55.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:55.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:55.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:55.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:55.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:55.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:55.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi184 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi184 to 17088M 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] boot 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:56.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:56.196 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:55:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:55:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi184 2024-09-19T08:55:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi184 to 17088M 2024-09-19T08:55:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] boot 2024-09-19T08:55:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T08:55:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:55 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:55:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:55:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi184 2024-09-19T08:55:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi184 to 17088M 2024-09-19T08:55:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:55:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: osd.2 [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] boot 2024-09-19T08:55:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T08:55:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:55:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:55 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:57 smithi184 ceph-mon[35007]: from='client.24178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:57 smithi184 ceph-mon[35007]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:55:57.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:57 smithi122 ceph-mon[34247]: from='client.24178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:57.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:57 smithi122 ceph-mon[34247]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:55:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:57 smithi083 ceph-mon[30926]: from='client.24178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:57 smithi083 ceph-mon[30926]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:55:58.103 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:57 smithi083 sudo[47099]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:55:58.104 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:57 smithi083 sudo[47099]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:58.104 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:57 smithi083 sudo[47099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:58.104 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:57 smithi083 sudo[47099]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:55:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:55:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:55:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4209922174' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fea364e4-e588-486f-8d83-113e0a7f5b49"}]: dispatch 2024-09-19T08:55:58.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:58.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4209922174' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fea364e4-e588-486f-8d83-113e0a7f5b49"}]': finished 2024-09-19T08:55:58.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:55:58.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:55:58.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:58 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/198343784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:58.431 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4209922174' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fea364e4-e588-486f-8d83-113e0a7f5b49"}]: dispatch 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4209922174' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fea364e4-e588-486f-8d83-113e0a7f5b49"}]': finished 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:55:58.432 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:58 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/198343784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:58.461 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:58 smithi083 sudo[47110]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:55:58.461 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:58 smithi083 sudo[47110]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:58.461 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:58 smithi083 sudo[47110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:58.461 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 08:55:58 smithi083 sudo[47110]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:55:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: pgmap v74: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:55:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4209922174' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fea364e4-e588-486f-8d83-113e0a7f5b49"}]: dispatch 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4209922174' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fea364e4-e588-486f-8d83-113e0a7f5b49"}]': finished 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:55:58.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:58 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/198343784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:58.686 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42372]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:55:58.686 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:58.686 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:58.686 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42372]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:55:58.960 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:55:58.960 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:58.960 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:58.960 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 08:55:58 smithi122 sudo[42375]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:55:59.209 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:59.209 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 ceph-mon[35007]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:55:59.209 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:55:59.209 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:59.209 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 ceph-mon[35007]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:55:59.209 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:58 smithi184 sudo[44013]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:55:59.210 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:58 smithi184 sudo[44013]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:59.210 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:58 smithi184 sudo[44013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:59.210 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:58 smithi184 sudo[44013]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:55:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:59 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:59 smithi122 ceph-mon[34247]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:55:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:59 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:55:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:59 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:55:59 smithi122 ceph-mon[34247]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:55:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 ceph-mon[30926]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:55:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:55:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:55:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 ceph-mon[30926]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:55:59.649 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44016]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:55:59.649 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44016]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:59.649 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:59.649 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44016]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:55:59.731 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47337]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:55:59.731 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47337]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:55:59.731 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:55:59.732 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47337]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:56:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47523]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:56:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47523]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:56:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:56:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:55:59 smithi083 sudo[47523]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:56:00.230 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44019]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:56:00.231 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44019]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:56:00.231 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:56:00.231 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:55:59 smithi184 sudo[44019]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:56:00.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:00.246+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3cec098130 con 0x7f3cf00ffcd0 2024-09-19T08:56:00.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 sudo[44022]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:56:00.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 sudo[44022]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:56:00.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 sudo[44022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:56:00.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 sudo[44022]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:56:00.730 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42378]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:56:00.730 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42378]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:56:00.730 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:56:00.730 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42378]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:01.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:01.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:00 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:01.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42381]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:56:01.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42381]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:56:01.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 sudo[42381]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:00 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:00 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:02.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:56:02.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:02.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:01 smithi184 ceph-mon[35007]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:02.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:01 smithi083 ceph-mon[30926]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:56:02.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:02.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:02.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:02.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:56:02.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:56:02.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:01 smithi122 ceph-mon[34247]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:04.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:03 smithi083 ceph-mon[30926]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:03 smithi122 ceph-mon[34247]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:04.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:03 smithi184 ceph-mon[35007]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:06.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:05 smithi122 ceph-mon[34247]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:06.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:05 smithi083 ceph-mon[30926]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:05 smithi184 ceph-mon[35007]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:07.135 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:56:07.135 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:56:07.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:56:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:08.080 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:07 smithi083 ceph-mon[30926]: Deploying daemon osd.3 on smithi083 2024-09-19T08:56:08.080 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:07 smithi083 ceph-mon[30926]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:08.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:07 smithi122 ceph-mon[34247]: Deploying daemon osd.3 on smithi083 2024-09-19T08:56:08.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:07 smithi122 ceph-mon[34247]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:07 smithi184 ceph-mon[35007]: Deploying daemon osd.3 on smithi083 2024-09-19T08:56:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:07 smithi184 ceph-mon[35007]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:09 smithi122 ceph-mon[34247]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:09 smithi083 ceph-mon[30926]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:09 smithi184 ceph-mon[35007]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:12.137 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:11 smithi083 ceph-mon[30926]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:12.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:11 smithi122 ceph-mon[34247]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:11 smithi184 ceph-mon[35007]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:13.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:12 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:13.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:12 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:13.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:12 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:13.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:12 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:13.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:12 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:13.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:12 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:12 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:12 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:12 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:14.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:13 smithi122 ceph-mon[34247]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:13 smithi083 ceph-mon[30926]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:13 smithi184 ceph-mon[35007]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:15 smithi122 ceph-mon[34247]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:16.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:15 smithi083 ceph-mon[30926]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:16.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:15 smithi184 ceph-mon[35007]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:16.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.647+0000 7f3ce77fe640 1 -- 172.21.15.83:0/3075248311 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3cf0062630 con 0x7f3cdc0a31e0 2024-09-19T08:56:16.647 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 3 on host 'smithi083' 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3cdc0a31e0 msgr2=0x7f3cdc0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3cdc0a31e0 0x7f3cdc0a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3cf019b560 tx=0x7f3ce0005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 msgr2=0x7f3cf019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf019a040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00d950 tx=0x7f3cec00de10 comp rx=0 tx=0).stop 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 shutdown_connections 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3cdc0a31e0 0x7f3cdc0a56a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3cf01021d0 0x7f3cf01a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3cf0100690 0x7f3cf019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 --2- 172.21.15.83:0/3075248311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cf00ffcd0 0x7f3cf019a040 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 >> 172.21.15.83:0/3075248311 conn(0x7f3cf00fba80 msgr2=0x7f3cf00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:16.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 shutdown_connections 2024-09-19T08:56:16.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:56:16.650+0000 7f3cf87e6640 1 -- 172.21.15.83:0/3075248311 wait complete. 2024-09-19T08:56:17.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:16 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:17.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:16 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:17.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:16 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:17.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:16 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:17.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:16 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:17.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:16 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:17.291 DEBUG:teuthology.orchestra.run.smithi083:osd.3> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:56:17.294 INFO:tasks.cephadm:Deploying osd.4 on smithi122 with /dev/vg_nvme/lv_3... 2024-09-19T08:56:17.294 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:56:17.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:16 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:17.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:16 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:17.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:16 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:17.555 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:56:18.207 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:17 smithi122 ceph-mon[34247]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:18.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:17 smithi083 ceph-mon[30926]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:17 smithi184 ceph-mon[35007]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:18.711 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 08:56:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3[49121]: 2024-09-19T08:56:18.358+0000 7f6cf5e7c640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:56:19.001 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:18 smithi083 ceph-mon[30926]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:56:19.053 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:18 smithi122 ceph-mon[34247]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:56:19.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:18 smithi184 ceph-mon[35007]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:56:20.091 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:56:20.117 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2024-09-19T08:56:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:19 smithi122 ceph-mon[34247]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:19 smithi122 ceph-mon[34247]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:56:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:19 smithi122 ceph-mon[34247]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:56:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:19 smithi122 ceph-mon[34247]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:56:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:20.211 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3[49121]: 2024-09-19T08:56:19.944+0000 7f6cf1dff640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:56:20.211 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3[49121]: 2024-09-19T08:56:19.951+0000 7f6cedc27640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:56:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-mon[30926]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-mon[30926]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:56:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-mon[30926]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:56:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-mon[30926]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:56:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:20.366 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:56:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:19 smithi184 ceph-mon[35007]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:19 smithi184 ceph-mon[35007]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:56:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:19 smithi184 ceph-mon[35007]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:56:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:19 smithi184 ceph-mon[35007]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:56:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 -- 172.21.15.122:0/3770112506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c1026d0 msgr2=0x7f7f7c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3770112506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c1026d0 0x7f7f7c108f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009ca0 tx=0x7f7f7402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 -- 172.21.15.122:0/3770112506 shutdown_connections 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3770112506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c1026d0 0x7f7f7c108f60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3770112506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f7c101d10 0x7f7f7c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3770112506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c100b10 0x7f7f7c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 -- 172.21.15.122:0/3770112506 >> 172.21.15.122:0/3770112506 conn(0x7f7f7c0fc2a0 msgr2=0x7f7f7c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 -- 172.21.15.122:0/3770112506 shutdown_connections 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 -- 172.21.15.122:0/3770112506 wait complete. 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 Processor -- start 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.860+0000 7f7f829ca640 1 -- start start 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 0x7f7f7c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c101d10 0x7f7f7c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f7c1026d0 0x7f7f7c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10c6a0 con 0x7f7f7c101d10 2024-09-19T08:56:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10c520 con 0x7f7f7c100b10 2024-09-19T08:56:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10c820 con 0x7f7f7c1026d0 2024-09-19T08:56:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 0x7f7f7c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 0x7f7f7c197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35310/0 (socket says 172.21.15.122:35310) 2024-09-19T08:56:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 -- 172.21.15.122:0/3260775443 learned_addr learned my addr 172.21.15.122:0/3260775443 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-19T08:56:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7b7fe640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c101d10 0x7f7f7c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f80f67640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f7c1026d0 0x7f7f7c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 -- 172.21.15.122:0/3260775443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f7c1026d0 msgr2=0x7f7f7c19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f7c1026d0 0x7f7f7c19f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 -- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c101d10 msgr2=0x7f7f7c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c101d10 0x7f7f7c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 -- 172.21.15.122:0/3260775443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c19fae0 con 0x7f7f7c100b10 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7b7fe640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c101d10 0x7f7f7c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f7bfff640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 0x7f7f7c197eb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400e9c0 tx=0x7f7f6400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400ccc0 con 0x7f7f7c100b10 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c19fdd0 con 0x7f7f7c100b10 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f640035f0 con 0x7f7f7c100b10 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400ce60 con 0x7f7f7c100b10 2024-09-19T08:56:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.861+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c1a0230 con 0x7f7f7c100b10 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.863+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c1a04f0 con 0x7f7f7c100b10 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.864+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7f640037a0 con 0x7f7f7c100b10 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.865+0000 7f7f797fa640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f680a3270 0x7f7f680a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.865+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7f7f640cebe0 con 0x7f7f7c100b10 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.865+0000 7f7f7b7fe640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f680a3270 0x7f7f680a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.865+0000 7f7f7b7fe640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f680a3270 0x7f7f680a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c1993d0 tx=0x7f7f6c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:20.869+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f6409cb90 con 0x7f7f7c100b10 2024-09-19T08:56:21.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:21.053+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7f7c1a06c0 con 0x7f7f680a3270 2024-09-19T08:56:21.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:56:21.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] boot 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:21.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] boot 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:21.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:21.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: osd.3 [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] boot 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:56:21.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:21.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:22.124 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:56:22.124 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:56:22.124 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi083 2024-09-19T08:56:22.124 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-19T08:56:22.124 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:22.124 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:22.125 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:22.125 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:22.125 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:21 smithi122 ceph-mon[34247]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:56:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:56:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:56:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi083 2024-09-19T08:56:22.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-19T08:56:22.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:22.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:22.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:22.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:22.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:21 smithi083 ceph-mon[30926]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:56:22.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:56:22.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi083 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:22.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:21 smithi184 ceph-mon[35007]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:56:23.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:22 smithi122 ceph-mon[34247]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:23.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:22 smithi122 ceph-mon[34247]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:56:23.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:22 smithi083 ceph-mon[30926]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:23.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:22 smithi083 ceph-mon[30926]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:56:23.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:22 smithi184 ceph-mon[35007]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:23.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:22 smithi184 ceph-mon[35007]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:56:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:56:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/620558184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]: dispatch 2024-09-19T08:56:24.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]: dispatch 2024-09-19T08:56:24.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]': finished 2024-09-19T08:56:24.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:56:24.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:56:24.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/620558184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]: dispatch 2024-09-19T08:56:24.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]: dispatch 2024-09-19T08:56:24.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]': finished 2024-09-19T08:56:24.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:56:24.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:56:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/620558184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]: dispatch 2024-09-19T08:56:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]: dispatch 2024-09-19T08:56:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c716b030-b753-495f-af07-bfe38073eedc"}]': finished 2024-09-19T08:56:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:56:24.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:25.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:24 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/1162078527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:25.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:24 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/1162078527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:25.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:24 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/1162078527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:26.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:25 smithi122 ceph-mon[34247]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:26.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:25 smithi083 ceph-mon[30926]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:25 smithi184 ceph-mon[35007]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:28.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:27 smithi122 ceph-mon[34247]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-19T08:56:28.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:27 smithi083 ceph-mon[30926]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-19T08:56:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:27 smithi184 ceph-mon[35007]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-09-19T08:56:30.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:29 smithi122 ceph-mon[34247]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T08:56:30.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:29 smithi083 ceph-mon[30926]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T08:56:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:29 smithi184 ceph-mon[35007]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T08:56:32.248 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:31 smithi122 ceph-mon[34247]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:56:32.248 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:56:32.248 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:31 smithi184 ceph-mon[35007]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:56:32.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:56:32.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:31 smithi083 ceph-mon[30926]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:56:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:56:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:33.157 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:32 smithi122 ceph-mon[34247]: Deploying daemon osd.4 on smithi122 2024-09-19T08:56:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:32 smithi184 ceph-mon[35007]: Deploying daemon osd.4 on smithi122 2024-09-19T08:56:33.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:32 smithi083 ceph-mon[30926]: Deploying daemon osd.4 on smithi122 2024-09-19T08:56:34.048 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:33 smithi122 ceph-mon[34247]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T08:56:34.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:33 smithi184 ceph-mon[35007]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T08:56:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:33 smithi083 ceph-mon[30926]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T08:56:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:35 smithi184 ceph-mon[35007]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T08:56:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:35 smithi122 ceph-mon[34247]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T08:56:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:35 smithi083 ceph-mon[30926]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T08:56:38.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:37 smithi122 ceph-mon[34247]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:56:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:37 smithi184 ceph-mon[35007]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:56:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:37 smithi083 ceph-mon[30926]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:56:39.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:39.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:39.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:39.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:40.304 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:39 smithi122 ceph-mon[34247]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:39 smithi184 ceph-mon[35007]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:39 smithi083 ceph-mon[30926]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:41.574 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.574 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.574 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:41.574 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:41.574 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:41 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.574 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:41 smithi122 ceph-mon[34247]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:41 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:41 smithi184 ceph-mon[35007]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:41 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:41 smithi083 ceph-mon[30926]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.890+0000 7f7f797fa640 1 -- 172.21.15.122:0/3260775443 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7f7c1a06c0 con 0x7f7f680a3270 2024-09-19T08:56:41.889 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 4 on host 'smithi122' 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f680a3270 msgr2=0x7f7f680a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f680a3270 0x7f7f680a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c1993d0 tx=0x7f7f6c009110 comp rx=0 tx=0).stop 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 msgr2=0x7f7f7c197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 0x7f7f7c197eb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400e9c0 tx=0x7f7f6400edc0 comp rx=0 tx=0).stop 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 shutdown_connections 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f680a3270 0x7f7f680a5730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f7c1026d0 0x7f7f7c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f7c101d10 0x7f7f7c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 --2- 172.21.15.122:0/3260775443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f7c100b10 0x7f7f7c197eb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 >> 172.21.15.122:0/3260775443 conn(0x7f7f7c0fc2a0 msgr2=0x7f7f7c06a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 shutdown_connections 2024-09-19T08:56:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:56:41.892+0000 7f7f829ca640 1 -- 172.21.15.122:0/3260775443 wait complete. 2024-09-19T08:56:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:42 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:42.529 DEBUG:teuthology.orchestra.run.smithi122:osd.4> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:56:42.532 INFO:tasks.cephadm:Deploying osd.5 on smithi184 with /dev/vg_nvme/lv_3... 2024-09-19T08:56:42.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:56:42.612 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:42.613 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:42.613 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:42 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:42.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:42.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:42.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:42 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:42.783 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:56:43.581 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:43 smithi184 ceph-mon[35007]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:43.658 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:43 smithi122 ceph-mon[34247]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:43.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:43 smithi083 ceph-mon[30926]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:43.924 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 08:56:43 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4[45115]: 2024-09-19T08:56:43.794+0000 7f6804f81640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:56:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:44 smithi184 ceph-mon[35007]: from='osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:56:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:44 smithi184 ceph-mon[35007]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:56:44.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:44 smithi122 ceph-mon[34247]: from='osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:56:44.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:44 smithi122 ceph-mon[34247]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:56:44.710 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:44 smithi083 ceph-mon[30926]: from='osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:56:44.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:44 smithi083 ceph-mon[30926]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:56:45.215 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:56:45.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2024-09-19T08:56:45.499 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:56:45.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.710 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4[45115]: 2024-09-19T08:56:45.383+0000 7f6800f04640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:56:45.710 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4[45115]: 2024-09-19T08:56:45.388+0000 7f67fcd2c640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:56:45.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:56:45.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:56:46.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.010+0000 7f6ebc406640 1 -- 172.21.15.184:0/1732134918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 msgr2=0x7f6eb4103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:46.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.010+0000 7f6ebc406640 1 --2- 172.21.15.184:0/1732134918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb4103270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009900 tx=0x7f6ea402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:46.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 -- 172.21.15.184:0/1732134918 shutdown_connections 2024-09-19T08:56:46.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 --2- 172.21.15.184:0/1732134918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb41037b0 0x7f6eb410a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 --2- 172.21.15.184:0/1732134918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb4103270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 --2- 172.21.15.184:0/1732134918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb4101bf0 0x7f6eb4101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 -- 172.21.15.184:0/1732134918 >> 172.21.15.184:0/1732134918 conn(0x7f6eb40fd3c0 msgr2=0x7f6eb40ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:46.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 -- 172.21.15.184:0/1732134918 shutdown_connections 2024-09-19T08:56:46.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 -- 172.21.15.184:0/1732134918 wait complete. 2024-09-19T08:56:46.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.011+0000 7f6ebc406640 1 Processor -- start 2024-09-19T08:56:46.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 -- start start 2024-09-19T08:56:46.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb4101bf0 0x7f6eb4197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb41037b0 0x7f6eb419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb410d700 con 0x7f6eb4101bf0 2024-09-19T08:56:46.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb410d580 con 0x7f6eb41037b0 2024-09-19T08:56:46.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6ebc406640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb410d880 con 0x7f6eb4102df0 2024-09-19T08:56:46.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.021 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb41982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:51580/0 (socket says 172.21.15.184:51580) 2024-09-19T08:56:46.021 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 -- 172.21.15.184:0/2147933675 learned_addr learned my addr 172.21.15.184:0/2147933675 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:56:46.021 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eba1a2640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb4101bf0 0x7f6eb4197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.021 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eba9a3640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb41037b0 0x7f6eb419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.021 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 -- 172.21.15.184:0/2147933675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb41037b0 msgr2=0x7f6eb419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb41037b0 0x7f6eb419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 -- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb4101bf0 msgr2=0x7f6eb4197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb4101bf0 0x7f6eb4197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 -- 172.21.15.184:0/2147933675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb419f9c0 con 0x7f6eb4102df0 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eba9a3640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb41037b0 0x7f6eb419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eba1a2640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb4101bf0 0x7f6eb4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.012+0000 7f6eb99a1640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb41982e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005940 tx=0x7f6ea4004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.013+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea403f030 con 0x7f6eb4102df0 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.013+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb419fc50 con 0x7f6eb4102df0 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.013+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ea4003cb0 con 0x7f6eb4102df0 2024-09-19T08:56:46.022 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.013+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4035070 con 0x7f6eb4102df0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.013+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb41a0180 con 0x7f6eb4102df0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.014+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb4108fc0 con 0x7f6eb4102df0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.015+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6ea4042030 con 0x7f6eb4102df0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.016+0000 7f6eab7fe640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ea00a3240 0x7f6ea00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.016+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f6ea40ef520 con 0x7f6eb4102df0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.016+0000 7f6eba1a2640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ea00a3240 0x7f6ea00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.017+0000 7f6eba1a2640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ea00a3240 0x7f6ea00a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0005fd0 tx=0x7f6eb0005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:46.023 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.019+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ea40bd3d0 con 0x7f6eb4102df0 2024-09-19T08:56:46.199 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:56:46.199+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6eb4062630 con 0x7f6ea00a3240 2024-09-19T08:56:46.643 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi122 2024-09-19T08:56:46.643 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi122 to 8543M 2024-09-19T08:56:46.643 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:56:46.644 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:56:46.644 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:46.644 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:46.644 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:46.644 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:46.644 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:46.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi122 2024-09-19T08:56:46.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi122 to 8543M 2024-09-19T08:56:46.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:56:46.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:56:46.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi122 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi122 to 8543M 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:46.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:46.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:46.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:46.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] boot 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:47.646 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:47 smithi184 ceph-mon[35007]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:47.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:56:47.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:56:47.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:47.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] boot 2024-09-19T08:56:47.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:47 smithi122 ceph-mon[34247]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: osd.4 [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] boot 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:56:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:47 smithi083 ceph-mon[30926]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:56:48.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:48 smithi184 ceph-mon[35007]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:56:48.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:48 smithi122 ceph-mon[34247]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:56:48.710 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:48 smithi083 ceph-mon[30926]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:56:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/875602860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]: dispatch 2024-09-19T08:56:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]: dispatch 2024-09-19T08:56:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]': finished 2024-09-19T08:56:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:56:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:56:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:49.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:49 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/1040363128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/875602860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]: dispatch 2024-09-19T08:56:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]: dispatch 2024-09-19T08:56:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]': finished 2024-09-19T08:56:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:49 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/1040363128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/875602860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]: dispatch 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]: dispatch 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afd43e53-08bc-4a58-b655-f00db3aa2b92"}]': finished 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:56:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:56:49.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:49.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:49 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/1040363128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:52.186 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:51 smithi122 ceph-mon[34247]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:51 smithi083 ceph-mon[30926]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:52.352 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:51 smithi184 ceph-mon[35007]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:54.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:53 smithi184 ceph-mon[35007]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:53 smithi122 ceph-mon[34247]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:54.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:53 smithi083 ceph-mon[30926]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:56.112 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:55 smithi184 ceph-mon[35007]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:55 smithi122 ceph-mon[34247]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:56.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:55 smithi083 ceph-mon[30926]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:57 smithi184 ceph-mon[35007]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:56:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:57 smithi184 ceph-mon[35007]: Deploying daemon osd.5 on smithi184 2024-09-19T08:56:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:57 smithi122 ceph-mon[34247]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:56:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:57 smithi122 ceph-mon[34247]: Deploying daemon osd.5 on smithi184 2024-09-19T08:56:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:57 smithi083 ceph-mon[30926]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:56:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:56:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:57 smithi083 ceph-mon[30926]: Deploying daemon osd.5 on smithi184 2024-09-19T08:57:00.065 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:56:59 smithi184 ceph-mon[35007]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:00.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:56:59 smithi122 ceph-mon[34247]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:56:59 smithi083 ceph-mon[30926]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:01.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:01 smithi184 ceph-mon[35007]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:02.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:01 smithi122 ceph-mon[34247]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:01 smithi083 ceph-mon[30926]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:03 smithi184 ceph-mon[35007]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:03 smithi122 ceph-mon[34247]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:03 smithi083 ceph-mon[30926]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:05 smithi184 ceph-mon[35007]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:05 smithi122 ceph-mon[34247]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:06.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:05 smithi083 ceph-mon[30926]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:07.166 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.167+0000 7f6eab7fe640 1 -- 172.21.15.184:0/2147933675 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6eb4062630 con 0x7f6ea00a3240 2024-09-19T08:57:07.167 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 5 on host 'smithi184' 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ea00a3240 msgr2=0x7f6ea00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ea00a3240 0x7f6ea00a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0005fd0 tx=0x7f6eb0005ee0 comp rx=0 tx=0).stop 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 msgr2=0x7f6eb41982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb41982e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005940 tx=0x7f6ea4004430 comp rx=0 tx=0).stop 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 shutdown_connections 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ea00a3240 0x7f6ea00a5700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6eb41037b0 0x7f6eb419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb4102df0 0x7f6eb41982e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:07.169 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 --2- 172.21.15.184:0/2147933675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb4101bf0 0x7f6eb4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:07.170 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 >> 172.21.15.184:0/2147933675 conn(0x7f6eb40fd3c0 msgr2=0x7f6eb4106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:07.170 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 shutdown_connections 2024-09-19T08:57:07.170 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:57:07.169+0000 7f6ebc406640 1 -- 172.21.15.184:0/2147933675 wait complete. 2024-09-19T08:57:07.758 DEBUG:teuthology.orchestra.run.smithi184:osd.5> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:57:07.761 INFO:tasks.cephadm:Deploying osd.6 on smithi083 with /dev/vg_nvme/lv_2... 2024-09-19T08:57:07.761 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:57:08.003 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:07 smithi184 ceph-mon[35007]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:08.003 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:07 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:08.003 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:07 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:08.003 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:07 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:08.015 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:08.136 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:07 smithi083 ceph-mon[30926]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:08.136 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:07 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:08.137 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:07 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:08.137 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:07 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:08.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:07 smithi122 ceph-mon[34247]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:08.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:07 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:08.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:07 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:08.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:07 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:09.108 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:08 smithi184 ceph-mon[35007]: from='osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:57:09.108 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:08 smithi184 ceph-mon[35007]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:57:09.108 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 08:57:08 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5[46853]: 2024-09-19T08:57:08.795+0000 7f3ddd434640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:57:09.208 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:08 smithi083 ceph-mon[30926]: from='osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:57:09.208 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:08 smithi083 ceph-mon[30926]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:57:09.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:08 smithi122 ceph-mon[34247]: from='osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:57:09.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:08 smithi122 ceph-mon[34247]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:57:10.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:09 smithi083 ceph-mon[30926]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:10.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:09 smithi083 ceph-mon[30926]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:57:10.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:09 smithi083 ceph-mon[30926]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:57:10.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:10.103 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:09 smithi083 ceph-mon[30926]: from='osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:57:10.103 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:09 smithi083 ceph-mon[30926]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:57:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:09 smithi122 ceph-mon[34247]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:09 smithi122 ceph-mon[34247]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:57:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:09 smithi122 ceph-mon[34247]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:57:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:09 smithi122 ceph-mon[34247]: from='osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:57:10.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:09 smithi122 ceph-mon[34247]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:57:10.355 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:09 smithi184 ceph-mon[35007]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:10.356 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:09 smithi184 ceph-mon[35007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:57:10.356 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:09 smithi184 ceph-mon[35007]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:57:10.356 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:10.356 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:09 smithi184 ceph-mon[35007]: from='osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:57:10.356 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:09 smithi184 ceph-mon[35007]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:57:10.790 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:57:10.817 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_2 2024-09-19T08:57:10.961 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5[46853]: 2024-09-19T08:57:10.660+0000 7f3dd93b7640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:57:10.961 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5[46853]: 2024-09-19T08:57:10.667+0000 7f3dd11d7640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:11.065 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='osd.5 ' entity='osd.5' 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.187 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:11.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:11.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:11.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:11.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:57:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:57:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:57:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='osd.5 ' entity='osd.5' 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:11.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:57:11.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='osd.5 ' entity='osd.5' 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:11.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:11.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 -- 172.21.15.83:0/19184002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20102e00 msgr2=0x7fde20103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 --2- 172.21.15.83:0/19184002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20102e00 0x7fde20103280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde10009900 tx=0x7fde1002a410 comp rx=0 tx=0).stop 2024-09-19T08:57:11.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 -- 172.21.15.83:0/19184002 shutdown_connections 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 --2- 172.21.15.83:0/19184002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 0x7fde2010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 --2- 172.21.15.83:0/19184002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20102e00 0x7fde20103280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 --2- 172.21.15.83:0/19184002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20101c00 0x7fde20102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 -- 172.21.15.83:0/19184002 >> 172.21.15.83:0/19184002 conn(0x7fde200fd390 msgr2=0x7fde200ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 -- 172.21.15.83:0/19184002 shutdown_connections 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.570+0000 7fde281bf640 1 -- 172.21.15.83:0/19184002 wait complete. 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 Processor -- start 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 -- start start 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 0x7fde20075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102e00 0x7fde200745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 0x7fde20074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fde2010d710 con 0x7fde20101c00 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fde2010d590 con 0x7fde201037c0 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde281bf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde2010d890 con 0x7fde20102e00 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 0x7fde20075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 0x7fde20075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54574/0 (socket says 172.21.15.83:54574) 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 -- 172.21.15.83:0/979568107 learned_addr learned my addr 172.21.15.83:0/979568107 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde2575a640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102e00 0x7fde200745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde2675c640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 0x7fde20074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 -- 172.21.15.83:0/979568107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102e00 msgr2=0x7fde200745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102e00 0x7fde200745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 -- 172.21.15.83:0/979568107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 msgr2=0x7fde20074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 0x7fde20074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde25f5b640 1 -- 172.21.15.83:0/979568107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde200753e0 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde2575a640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102e00 0x7fde200745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.571+0000 7fde2675c640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 0x7fde20074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.572+0000 7fde25f5b640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 0x7fde20075f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00d950 tx=0x7fde1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.572+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c017020 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.572+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde1c009c30 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.572+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde201a1fe0 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.572+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00f6b0 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.572+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde201a23d0 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.573+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde20109090 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.574+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fde1c01a020 con 0x7fde20101c00 2024-09-19T08:57:11.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.575+0000 7fde16ffd640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde0c0a3240 0x7fde0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.575+0000 7fde2575a640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde0c0a3240 0x7fde0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.575+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7fde1c0cea70 con 0x7fde20101c00 2024-09-19T08:57:11.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.575+0000 7fde2575a640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde0c0a3240 0x7fde0c0a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde20075d10 tx=0x7fde10032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.579+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde1c021020 con 0x7fde20101c00 2024-09-19T08:57:11.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:11.754+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fde20062630 con 0x7fde0c0a3240 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi184 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi184 to 8544M 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] boot 2024-09-19T08:57:12.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:57:12.163 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:12.163 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:12.163 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:12.163 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi184 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi184 to 8544M 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] boot 2024-09-19T08:57:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:57:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:57:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:57:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi184 2024-09-19T08:57:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi184 to 8544M 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: osd.5 [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] boot 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:13.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:12 smithi083 ceph-mon[30926]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:13.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:12 smithi083 ceph-mon[30926]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:57:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:12 smithi184 ceph-mon[35007]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:12 smithi184 ceph-mon[35007]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:57:13.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:12 smithi122 ceph-mon[34247]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:13.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:12 smithi122 ceph-mon[34247]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:57:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:13 smithi083 ceph-mon[30926]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:13 smithi083 ceph-mon[30926]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:57:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:13 smithi184 ceph-mon[35007]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:13 smithi184 ceph-mon[35007]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:57:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:13 smithi122 ceph-mon[34247]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:13 smithi122 ceph-mon[34247]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:57:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:57:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3452041549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdbae412-c690-425e-ac5e-96d1481a5463"}]: dispatch 2024-09-19T08:57:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3452041549' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdbae412-c690-425e-ac5e-96d1481a5463"}]': finished 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3386876751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:15 smithi122 ceph-mon[34247]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3452041549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdbae412-c690-425e-ac5e-96d1481a5463"}]: dispatch 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3452041549' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdbae412-c690-425e-ac5e-96d1481a5463"}]': finished 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:57:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:15.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3386876751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:15.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:15 smithi083 ceph-mon[30926]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:15.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:57:15.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3452041549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdbae412-c690-425e-ac5e-96d1481a5463"}]: dispatch 2024-09-19T08:57:15.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3452041549' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdbae412-c690-425e-ac5e-96d1481a5463"}]': finished 2024-09-19T08:57:15.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:57:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3386876751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:15 smithi184 ceph-mon[35007]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:18.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:17 smithi122 ceph-mon[34247]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-19T08:57:18.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:17 smithi083 ceph-mon[30926]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-19T08:57:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:17 smithi184 ceph-mon[35007]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-19T08:57:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:19 smithi122 ceph-mon[34247]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:57:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:19 smithi083 ceph-mon[30926]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:57:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:19 smithi184 ceph-mon[35007]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:57:21.974 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:21 smithi083 ceph-mon[30926]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T08:57:22.204 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:21 smithi184 ceph-mon[35007]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T08:57:22.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:21 smithi122 ceph-mon[34247]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T08:57:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:23 smithi122 ceph-mon[34247]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:57:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:57:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:24.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:23 smithi122 ceph-mon[34247]: Deploying daemon osd.6 on smithi083 2024-09-19T08:57:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:23 smithi083 ceph-mon[30926]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:57:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:57:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:24.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:23 smithi083 ceph-mon[30926]: Deploying daemon osd.6 on smithi083 2024-09-19T08:57:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:23 smithi184 ceph-mon[35007]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:57:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:57:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:23 smithi184 ceph-mon[35007]: Deploying daemon osd.6 on smithi083 2024-09-19T08:57:26.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:25 smithi122 ceph-mon[34247]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:57:26.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:25 smithi083 ceph-mon[30926]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:57:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:25 smithi184 ceph-mon[35007]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:57:28.048 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:27 smithi083 ceph-mon[30926]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:57:28.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:27 smithi122 ceph-mon[34247]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:57:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:27 smithi184 ceph-mon[35007]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:57:30.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:29 smithi083 ceph-mon[30926]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:30.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:30.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:30.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:30.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:29 smithi122 ceph-mon[34247]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:30.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:30.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:30.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:30.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:29 smithi184 ceph-mon[35007]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:30.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:30.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:30.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:32.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:31 smithi122 ceph-mon[34247]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:32.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:31 smithi083 ceph-mon[30926]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:31 smithi184 ceph-mon[35007]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:33.273 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 6 on host 'smithi083' 2024-09-19T08:57:33.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.273+0000 7fde16ffd640 1 -- 172.21.15.83:0/979568107 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fde20062630 con 0x7fde0c0a3240 2024-09-19T08:57:33.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.275+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde0c0a3240 msgr2=0x7fde0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:33.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.275+0000 7fde281bf640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde0c0a3240 0x7fde0c0a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde20075d10 tx=0x7fde10032d20 comp rx=0 tx=0).stop 2024-09-19T08:57:33.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.275+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 msgr2=0x7fde20075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.275+0000 7fde281bf640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 0x7fde20075f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00d950 tx=0x7fde1c00de10 comp rx=0 tx=0).stop 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 shutdown_connections 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fde0c0a3240 0x7fde0c0a5700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde201037c0 0x7fde20074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102e00 0x7fde200745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 --2- 172.21.15.83:0/979568107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde20101c00 0x7fde20075f90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 >> 172.21.15.83:0/979568107 conn(0x7fde200fd390 msgr2=0x7fde20106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 shutdown_connections 2024-09-19T08:57:33.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:57:33.276+0000 7fde281bf640 1 -- 172.21.15.83:0/979568107 wait complete. 2024-09-19T08:57:33.631 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.632 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.632 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:33.632 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:33.632 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.632 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:33 smithi083 ceph-mon[30926]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:33.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:33.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:33.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:33 smithi184 ceph-mon[35007]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:33.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:33.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:33.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:33.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:33 smithi122 ceph-mon[34247]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:33.967 DEBUG:teuthology.orchestra.run.smithi083:osd.6> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:57:33.969 INFO:tasks.cephadm:Deploying osd.7 on smithi122 with /dev/vg_nvme/lv_2... 2024-09-19T08:57:33.970 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:57:34.220 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:57:34.342 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:34.342 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:34.342 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:34 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:34.477 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:34.477 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:34.478 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:34 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:34.498 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:34.498 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:34.498 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:34 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:35.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:35 smithi083 ceph-mon[30926]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:35.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:35 smithi083 ceph-mon[30926]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:57:35.462 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 08:57:35 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6[56053]: 2024-09-19T08:57:35.110+0000 7f85c34bb640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:57:35.638 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:35 smithi122 ceph-mon[34247]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:35.638 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:35 smithi122 ceph-mon[34247]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:57:35.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:35 smithi184 ceph-mon[35007]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:35.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:35 smithi184 ceph-mon[35007]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:57:36.461 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 08:57:36 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6[56053]: 2024-09-19T08:57:36.242+0000 7f85bf43e640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:57:36.461 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 08:57:36 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6[56053]: 2024-09-19T08:57:36.251+0000 7f85bb266640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:36 smithi083 ceph-mon[30926]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:57:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:36 smithi083 ceph-mon[30926]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:57:36.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:36 smithi083 ceph-mon[30926]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:57:36.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:36 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:36.540 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:36 smithi122 ceph-mon[34247]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:36 smithi122 ceph-mon[34247]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:36 smithi122 ceph-mon[34247]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:57:36.541 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:36 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:36.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:36 smithi184 ceph-mon[35007]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:57:36.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:36 smithi184 ceph-mon[35007]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:57:36.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:36 smithi184 ceph-mon[35007]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:57:36.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:36 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:36.882 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:57:36.909 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2024-09-19T08:57:37.161 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:57:37.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:57:37.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:57:37.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:37.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:37.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:37.554 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi083 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:37.555 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:57:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:57:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi083 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:37.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 -- 172.21.15.122:0/3135527851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 msgr2=0x7f9d34109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3135527851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34109d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009ca0 tx=0x7f9d2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 -- 172.21.15.122:0/3135527851 shutdown_connections 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3135527851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34109d10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3135527851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34104f90 0x7f9d34107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3135527851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d34102660 0x7f9d34104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 -- 172.21.15.122:0/3135527851 >> 172.21.15.122:0/3135527851 conn(0x7f9d340fc280 msgr2=0x7f9d340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 -- 172.21.15.122:0/3135527851 shutdown_connections 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 -- 172.21.15.122:0/3135527851 wait complete. 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 Processor -- start 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 -- start start 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34102660 0x7f9d34101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.666+0000 7f9d3b175640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d34104f90 0x7f9d34100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d3b175640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d3b175640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410d730 con 0x7f9d34102660 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d3b175640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410d5b0 con 0x7f9d341078c0 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d3b175640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410d8b0 con 0x7f9d34104f90 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45210/0 (socket says 172.21.15.122:45210) 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 -- 172.21.15.122:0/3902230953 learned_addr learned my addr 172.21.15.122:0/3902230953 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d2bfff640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d34104f90 0x7f9d34100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d38f11640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34102660 0x7f9d34101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 -- 172.21.15.122:0/3902230953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d34104f90 msgr2=0x7f9d34100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d34104f90 0x7f9d34100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 -- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34102660 msgr2=0x7f9d34101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34102660 0x7f9d34101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 -- 172.21.15.122:0/3902230953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d34101410 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d38f11640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34102660 0x7f9d34101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d39712640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34100b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009dc0 tx=0x7f9d2c003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c032ec0 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d2c0044f0 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d341a1eb0 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.667+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c030d40 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.668+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d341a2360 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.669+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d340fdd70 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.670+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9d2c004040 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.670+0000 7f9d29ffb640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f9d1c0a33e0 0x7f9d1c0a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.670+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f9d2c0f0210 con 0x7f9d341078c0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.671+0000 7f9d38f11640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f9d1c0a33e0 0x7f9d1c0a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.671+0000 7f9d38f11640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f9d1c0a33e0 0x7f9d1c0a58a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009b40 tx=0x7f9d30005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.675+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d2c0bdc40 con 0x7f9d341078c0 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi083 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:37.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:37.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:37.852+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9d34062630 con 0x7f9d1c0a33e0 2024-09-19T08:57:38.596 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] boot 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:38.597 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] boot 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:38.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:38.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:38.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: osd.6 [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] boot 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:38.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:38.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:39.588 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:39 smithi122 ceph-mon[34247]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:57:39.588 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:39 smithi122 ceph-mon[34247]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:39.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:39 smithi184 ceph-mon[35007]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:57:39.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:39 smithi184 ceph-mon[35007]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:39.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:39 smithi083 ceph-mon[30926]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:57:39.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:39 smithi083 ceph-mon[30926]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:40.657 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:40 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/1268845097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]: dispatch 2024-09-19T08:57:40.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:40 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]: dispatch 2024-09-19T08:57:40.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:40 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]': finished 2024-09-19T08:57:40.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:40 smithi184 ceph-mon[35007]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:57:40.658 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:57:40.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:40 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/1268845097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]: dispatch 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:40 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]: dispatch 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:40 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]': finished 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:40 smithi122 ceph-mon[34247]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:40 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/1268845097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]: dispatch 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:40 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]: dispatch 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:40 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f12c9d22-a585-4926-8058-be2ba2ba2fd0"}]': finished 2024-09-19T08:57:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:40 smithi083 ceph-mon[30926]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:57:40.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:57:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:41 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/2729760103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:41 smithi184 ceph-mon[35007]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:41.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:41 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/2729760103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:41.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:41 smithi122 ceph-mon[34247]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:41 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/2729760103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:41 smithi083 ceph-mon[30926]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:44.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:43 smithi122 ceph-mon[34247]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:43 smithi083 ceph-mon[30926]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:43 smithi184 ceph-mon[35007]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:45 smithi122 ceph-mon[34247]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:46.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:45 smithi083 ceph-mon[30926]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:45 smithi184 ceph-mon[35007]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:48.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:47 smithi122 ceph-mon[34247]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:48.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:47 smithi083 ceph-mon[30926]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:47 smithi184 ceph-mon[35007]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:49.109 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:48 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:57:49.109 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:48 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:49.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:48 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:57:49.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:48 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:48 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:57:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:48 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:50.078 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:49 smithi122 ceph-mon[34247]: Deploying daemon osd.7 on smithi122 2024-09-19T08:57:50.079 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:49 smithi122 ceph-mon[34247]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:49 smithi083 ceph-mon[30926]: Deploying daemon osd.7 on smithi122 2024-09-19T08:57:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:49 smithi083 ceph-mon[30926]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:49 smithi184 ceph-mon[35007]: Deploying daemon osd.7 on smithi122 2024-09-19T08:57:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:49 smithi184 ceph-mon[35007]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:52.060 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:51 smithi122 ceph-mon[34247]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:52.201 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:51 smithi184 ceph-mon[35007]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:51 smithi083 ceph-mon[30926]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:54.158 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:53 smithi122 ceph-mon[34247]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:54.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:53 smithi083 ceph-mon[30926]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:53 smithi184 ceph-mon[35007]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:55.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:55.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:55.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:55 smithi122 ceph-mon[34247]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:56.210 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:55 smithi083 ceph-mon[30926]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:55 smithi184 ceph-mon[35007]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:57 smithi122 ceph-mon[34247]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:58.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:57 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:57 smithi083 ceph-mon[30926]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:58.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:57 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.375+0000 7f9d29ffb640 1 -- 172.21.15.122:0/3902230953 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9d34062630 con 0x7f9d1c0a33e0 2024-09-19T08:57:58.375 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 7 on host 'smithi122' 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f9d1c0a33e0 msgr2=0x7f9d1c0a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f9d1c0a33e0 0x7f9d1c0a58a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009b40 tx=0x7f9d30005e50 comp rx=0 tx=0).stop 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 msgr2=0x7f9d34100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34100b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009dc0 tx=0x7f9d2c003ba0 comp rx=0 tx=0).stop 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 shutdown_connections 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f9d1c0a33e0 0x7f9d1c0a58a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d341078c0 0x7f9d34100b50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d34104f90 0x7f9d34100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 --2- 172.21.15.122:0/3902230953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d34102660 0x7f9d34101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:58.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.377+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 >> 172.21.15.122:0/3902230953 conn(0x7f9d340fc280 msgr2=0x7f9d34102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:58.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.378+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 shutdown_connections 2024-09-19T08:57:58.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:57:58.378+0000 7f9d3b175640 1 -- 172.21.15.122:0/3902230953 wait complete. 2024-09-19T08:57:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:57 smithi184 ceph-mon[35007]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:57:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:57 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:59.015 DEBUG:teuthology.orchestra.run.smithi122:osd.7> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:57:59.018 INFO:tasks.cephadm:Deploying osd.8 on smithi184 with /dev/vg_nvme/lv_2... 2024-09-19T08:57:59.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:57:59.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:59.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:59.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:59.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:59.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:59.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:59.276 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:57:59.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:59.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:57:59.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:00.189 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:57:59 smithi122 ceph-mon[34247]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:57:59 smithi083 ceph-mon[30926]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:57:59 smithi184 ceph-mon[35007]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:00.458 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 08:58:00 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7[51544]: 2024-09-19T08:58:00.415+0000 7fdfcc8eb640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:58:01.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:00 smithi122 ceph-mon[34247]: from='osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:58:01.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:00 smithi122 ceph-mon[34247]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:58:01.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:00 smithi083 ceph-mon[30926]: from='osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:58:01.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:00 smithi083 ceph-mon[30926]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:58:01.237 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:00 smithi184 ceph-mon[35007]: from='osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:58:01.237 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:00 smithi184 ceph-mon[35007]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:58:02.089 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:58:02.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2024-09-19T08:58:02.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:02.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:58:02.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:58:02.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.368 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:58:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:58:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:58:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 -- 172.21.15.184:0/2896200082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 msgr2=0x7f0360108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 --2- 172.21.15.184:0/2896200082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f0360108f60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0358009ca0 tx=0x7f035802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 -- 172.21.15.184:0/2896200082 shutdown_connections 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 --2- 172.21.15.184:0/2896200082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f0360108f60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 --2- 172.21.15.184:0/2896200082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 0x7f0360102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 --2- 172.21.15.184:0/2896200082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0360100b10 0x7f0360100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 -- 172.21.15.184:0/2896200082 >> 172.21.15.184:0/2896200082 conn(0x7f03600fc2a0 msgr2=0x7f03600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:02.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 -- 172.21.15.184:0/2896200082 shutdown_connections 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.865+0000 7f0368201640 1 -- 172.21.15.184:0/2896200082 wait complete. 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 Processor -- start 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 -- start start 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0360100b10 0x7f036006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 0x7f036019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f036019f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f036010c640 con 0x7f0360100b10 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f036010c4c0 con 0x7f0360101d10 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0368201640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f036010c7c0 con 0x7f03601026d0 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f036019f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f036019f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:58516/0 (socket says 172.21.15.184:58516) 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 -- 172.21.15.184:0/3044917205 learned_addr learned my addr 172.21.15.184:0/3044917205 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:58:02.883 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036579c640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 0x7f036019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f0365f9d640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0360100b10 0x7f036006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 -- 172.21.15.184:0/3044917205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 msgr2=0x7f036019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 0x7f036019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 -- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0360100b10 msgr2=0x7f036006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0360100b10 0x7f036006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036679e640 1 -- 172.21.15.184:0/3044917205 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036019fa90 con 0x7f03601026d0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.866+0000 7f036579c640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 0x7f036019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.867+0000 7f036679e640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f036019f180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0358009dc0 tx=0x7f0358003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.867+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358032ec0 con 0x7f03601026d0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.867+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03580044f0 con 0x7f03601026d0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.867+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036019fcc0 con 0x7f03601026d0 2024-09-19T08:58:02.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.867+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358030d40 con 0x7f03601026d0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.867+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03601a0200 con 0x7f03601026d0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.868+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0360107fb0 con 0x7f03601026d0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.869+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0358004040 con 0x7f03601026d0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.870+0000 7f0352ffd640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f034c0a33e0 0x7f034c0a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.870+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f03580f0360 con 0x7f03601026d0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.870+0000 7f0365f9d640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f034c0a33e0 0x7f034c0a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.871+0000 7f0365f9d640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f034c0a33e0 0x7f034c0a58a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0360101b70 tx=0x7f035400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:02.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:02.874+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03580bdd00 con 0x7f03601026d0 2024-09-19T08:58:02.960 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7[51544]: 2024-09-19T08:58:02.597+0000 7fdfc886e640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:58:02.960 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7[51544]: 2024-09-19T08:58:02.605+0000 7fdfc068e640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:03.054 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:03.054+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0360062630 con 0x7f034c0a33e0 2024-09-19T08:58:03.054 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi122 2024-09-19T08:58:03.054 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi122 to 5695M 2024-09-19T08:58:03.054 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:58:03.054 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:58:03.054 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:03.054 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:03.055 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:02 smithi184 ceph-mon[35007]: from='osd.7 ' entity='osd.7' 2024-09-19T08:58:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi122 2024-09-19T08:58:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi122 to 5695M 2024-09-19T08:58:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:58:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:58:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:02 smithi122 ceph-mon[34247]: from='osd.7 ' entity='osd.7' 2024-09-19T08:58:03.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi122 2024-09-19T08:58:03.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi122 to 5695M 2024-09-19T08:58:03.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:58:03.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:58:03.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:03.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:03.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:02 smithi083 ceph-mon[30926]: from='osd.7 ' entity='osd.7' 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] boot 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:58:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:04.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:04.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:04.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:03 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:58:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:58:04.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] boot 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:03 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: osd.7 [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] boot 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:58:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:58:04.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:04.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:04.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:03 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:05.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:04 smithi184 ceph-mon[35007]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:05.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:04 smithi184 ceph-mon[35007]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:58:05.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:04 smithi122 ceph-mon[34247]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:05.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:04 smithi122 ceph-mon[34247]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:58:05.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:04 smithi083 ceph-mon[30926]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:05.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:04 smithi083 ceph-mon[30926]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:58:06.094 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:06.094 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:58:06.094 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T08:58:06.094 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/1797450303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]: dispatch 2024-09-19T08:58:06.095 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]: dispatch 2024-09-19T08:58:06.095 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]': finished 2024-09-19T08:58:06.095 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:58:06.095 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:05 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:58:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T08:58:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/1797450303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]: dispatch 2024-09-19T08:58:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]: dispatch 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]': finished 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:05 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/1797450303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]: dispatch 2024-09-19T08:58:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]: dispatch 2024-09-19T08:58:06.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3952f1a9-50b1-4036-94a8-22eb5e763ede"}]': finished 2024-09-19T08:58:06.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:58:06.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:05 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/1728477716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:07.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/1728477716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:06 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/1728477716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:07 smithi184 ceph-mon[35007]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:08.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:08 smithi122 ceph-mon[34247]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:08.460 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:07 smithi083 ceph-mon[30926]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:10.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:10 smithi184 ceph-mon[35007]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:10 smithi122 ceph-mon[34247]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:10 smithi083 ceph-mon[30926]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:12.247 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:12 smithi184 ceph-mon[35007]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:12 smithi122 ceph-mon[34247]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:12 smithi083 ceph-mon[30926]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:14.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:14 smithi083 ceph-mon[30926]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:14.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:58:14.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:14.326 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:14 smithi184 ceph-mon[35007]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:14.326 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:58:14.326 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:14 smithi122 ceph-mon[34247]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:58:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:15.376 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:15 smithi184 ceph-mon[35007]: Deploying daemon osd.8 on smithi184 2024-09-19T08:58:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:15 smithi122 ceph-mon[34247]: Deploying daemon osd.8 on smithi184 2024-09-19T08:58:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:15 smithi083 ceph-mon[30926]: Deploying daemon osd.8 on smithi184 2024-09-19T08:58:16.264 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:16 smithi184 ceph-mon[35007]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:16.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:16 smithi122 ceph-mon[34247]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:16 smithi083 ceph-mon[30926]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:17.238 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:17 smithi184 ceph-mon[35007]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:17.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:17 smithi122 ceph-mon[34247]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:17 smithi083 ceph-mon[30926]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:19 smithi122 ceph-mon[34247]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:19 smithi083 ceph-mon[30926]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:20.218 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:19 smithi184 ceph-mon[35007]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:20.218 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:20.219 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:20.219 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:22.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:21 smithi122 ceph-mon[34247]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:22.210 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:21 smithi184 ceph-mon[35007]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:22.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:21 smithi083 ceph-mon[30926]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:23.440 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.440+0000 7f0352ffd640 1 -- 172.21.15.184:0/3044917205 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0360062630 con 0x7f034c0a33e0 2024-09-19T08:58:23.441 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 8 on host 'smithi184' 2024-09-19T08:58:23.443 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f034c0a33e0 msgr2=0x7f034c0a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.443 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f034c0a33e0 0x7f034c0a58a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0360101b70 tx=0x7f035400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.443 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 msgr2=0x7f036019f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.443 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f036019f180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0358009dc0 tx=0x7f0358003ba0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 shutdown_connections 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f034c0a33e0 0x7f034c0a58a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03601026d0 0x7f036019f180 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0360101d10 0x7f036019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 --2- 172.21.15.184:0/3044917205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0360100b10 0x7f036006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.443+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 >> 172.21.15.184:0/3044917205 conn(0x7f03600fc2a0 msgr2=0x7f0360105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.444+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 shutdown_connections 2024-09-19T08:58:23.444 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:58:23.444+0000 7f0368201640 1 -- 172.21.15.184:0/3044917205 wait complete. 2024-09-19T08:58:23.624 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:23.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:23.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.625 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:23 smithi184 ceph-mon[35007]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:23.644 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.644 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.644 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:23.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:23.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:23 smithi122 ceph-mon[34247]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:23.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:23 smithi083 ceph-mon[30926]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:24.106 DEBUG:teuthology.orchestra.run.smithi184:osd.8> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:58:24.108 INFO:tasks.cephadm:Deploying osd.9 on smithi083 with /dev/vg_nvme/lv_1... 2024-09-19T08:58:24.108 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:58:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:24 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:24 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:24 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:24.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:24 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:24.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:24 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:24.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:24 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:24.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:24 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:24.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:24 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:24.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:24 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:25.639 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:25 smithi083 ceph-mon[30926]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:25.642 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:25 smithi184 ceph-mon[35007]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:25.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:25 smithi122 ceph-mon[34247]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:25.899 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 08:58:25 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8[53735]: 2024-09-19T08:58:25.728+0000 7f87035d8640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:58:26.479 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:26 smithi083 ceph-mon[30926]: from='osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:58:26.480 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:26 smithi083 ceph-mon[30926]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:58:26.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:26 smithi184 ceph-mon[35007]: from='osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:58:26.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:26 smithi184 ceph-mon[35007]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:58:26.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:26 smithi122 ceph-mon[34247]: from='osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:58:26.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:26 smithi122 ceph-mon[34247]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:58:27.171 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_1 2024-09-19T08:58:27.421 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:58:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:58:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:27.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:27.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:27.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:27.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:58:27.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:58:27.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:27.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:58:27.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:58:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:27.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:27.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:27.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:27.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.919+0000 7f7c454fd640 1 -- 172.21.15.83:0/985290307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 msgr2=0x7f7c40102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.919+0000 7f7c454fd640 1 --2- 172.21.15.83:0/985290307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40102000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009ca0 tx=0x7f7c3002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 -- 172.21.15.83:0/985290307 shutdown_connections 2024-09-19T08:58:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 --2- 172.21.15.83:0/985290307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c401037c0 0x7f7c4010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 --2- 172.21.15.83:0/985290307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c40102e00 0x7f7c40103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 --2- 172.21.15.83:0/985290307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40102000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 -- 172.21.15.83:0/985290307 >> 172.21.15.83:0/985290307 conn(0x7f7c400fd390 msgr2=0x7f7c400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 -- 172.21.15.83:0/985290307 shutdown_connections 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 -- 172.21.15.83:0/985290307 wait complete. 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.920+0000 7f7c454fd640 1 Processor -- start 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 -- start start 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c40102e00 0x7f7c401983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c401037c0 0x7f7c4019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4010d7b0 con 0x7f7c40101c00 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4010d630 con 0x7f7c40102e00 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c454fd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4010d930 con 0x7f7c401037c0 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48934/0 (socket says 172.21.15.83:48934) 2024-09-19T08:58:27.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 -- 172.21.15.83:0/639743307 learned_addr learned my addr 172.21.15.83:0/639743307 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3f7fe640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c401037c0 0x7f7c4019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3e7fc640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c40102e00 0x7f7c401983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 -- 172.21.15.83:0/639743307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c401037c0 msgr2=0x7f7c4019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c401037c0 0x7f7c4019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 -- 172.21.15.83:0/639743307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c40102e00 msgr2=0x7f7c401983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c40102e00 0x7f7c401983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 -- 172.21.15.83:0/639743307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4019fab0 con 0x7f7c40101c00 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3e7fc640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c40102e00 0x7f7c401983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c3effd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40197e80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c30005e30 tx=0x7f7c30003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.921+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30032ec0 con 0x7f7c40101c00 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.922+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4019fd40 con 0x7f7c40101c00 2024-09-19T08:58:27.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.922+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c300044f0 con 0x7f7c40101c00 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.922+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30030d90 con 0x7f7c40101c00 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.922+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c401a0210 con 0x7f7c40101c00 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.922+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c40108ff0 con 0x7f7c40101c00 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.924+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7c300305c0 con 0x7f7c40101c00 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.924+0000 7f7c37fff640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c2c0a3410 0x7f7c2c0a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.925+0000 7f7c3e7fc640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c2c0a3410 0x7f7c2c0a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.925+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7f7c300f05c0 con 0x7f7c40101c00 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.925+0000 7f7c3e7fc640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c2c0a3410 0x7f7c2c0a58d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c401993a0 tx=0x7f7c28005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:27.928+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c300bddb0 con 0x7f7c40101c00 2024-09-19T08:58:28.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:28.103+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7c40062630 con 0x7f7c2c0a3410 2024-09-19T08:58:28.395 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8[53735]: 2024-09-19T08:58:28.076+0000 7f86ffd6f640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:58:28.395 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8[53735]: 2024-09-19T08:58:28.084+0000 7f86f737b640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:28.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi184 2024-09-19T08:58:28.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi184 to 5696M 2024-09-19T08:58:28.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:58:28.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:58:28.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:28.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:28.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='osd.8 ' entity='osd.8' 2024-09-19T08:58:28.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:28.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:28.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:28 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi184 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi184 to 5696M 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='osd.8 ' entity='osd.8' 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:28.661 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:28 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi184 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi184 to 5696M 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='osd.8 ' entity='osd.8' 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:28.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:28.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:28 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:29.619 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] boot 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:29.620 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:29 smithi083 ceph-mon[30926]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] boot 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:29 smithi184 ceph-mon[35007]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: osd.8 [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] boot 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:58:29.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:58:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:29 smithi122 ceph-mon[34247]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:58:30.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:30 smithi122 ceph-mon[34247]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:58:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:30 smithi083 ceph-mon[30926]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:58:30.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:30 smithi184 ceph-mon[35007]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:58:31.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:58:31.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2305534755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "814dd884-f3d2-451c-afb6-44ea8e34c75e"}]: dispatch 2024-09-19T08:58:31.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2305534755' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "814dd884-f3d2-451c-afb6-44ea8e34c75e"}]': finished 2024-09-19T08:58:31.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:31 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/846171150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2305534755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "814dd884-f3d2-451c-afb6-44ea8e34c75e"}]: dispatch 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2305534755' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "814dd884-f3d2-451c-afb6-44ea8e34c75e"}]': finished 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:58:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:31.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:31.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:31 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/846171150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2305534755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "814dd884-f3d2-451c-afb6-44ea8e34c75e"}]: dispatch 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2305534755' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "814dd884-f3d2-451c-afb6-44ea8e34c75e"}]': finished 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:31.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:31 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/846171150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:32 smithi122 ceph-mon[34247]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:58:32.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:32 smithi083 ceph-mon[30926]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:58:32.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:33.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:32 smithi184 ceph-mon[35007]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:58:33.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:33.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:33 smithi122 ceph-mon[34247]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:58:33.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:33.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:33 smithi122 ceph-mon[34247]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:33 smithi083 ceph-mon[30926]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:58:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:33 smithi083 ceph-mon[30926]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:34.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:33 smithi184 ceph-mon[35007]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:58:34.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:34.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:33 smithi184 ceph-mon[35007]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:36.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:35 smithi122 ceph-mon[34247]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-19T08:58:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:35 smithi083 ceph-mon[30926]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-19T08:58:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:35 smithi184 ceph-mon[35007]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-19T08:58:38.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:37 smithi083 ceph-mon[30926]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T08:58:38.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:37 smithi122 ceph-mon[34247]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T08:58:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:37 smithi184 ceph-mon[35007]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T08:58:40.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:39 smithi083 ceph-mon[30926]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:58:40.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:58:40.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:40.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:39 smithi122 ceph-mon[34247]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:58:40.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:58:40.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:39 smithi184 ceph-mon[35007]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:58:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:58:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:41.093 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:40 smithi083 ceph-mon[30926]: Deploying daemon osd.9 on smithi083 2024-09-19T08:58:41.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:40 smithi122 ceph-mon[34247]: Deploying daemon osd.9 on smithi083 2024-09-19T08:58:41.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:40 smithi184 ceph-mon[35007]: Deploying daemon osd.9 on smithi083 2024-09-19T08:58:42.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:41 smithi083 ceph-mon[30926]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:58:42.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:41 smithi122 ceph-mon[34247]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:58:42.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:41 smithi184 ceph-mon[35007]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:58:44.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:43 smithi122 ceph-mon[34247]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:58:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:43 smithi083 ceph-mon[30926]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:58:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:43 smithi184 ceph-mon[35007]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T08:58:46.127 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:45 smithi083 ceph-mon[30926]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:58:46.128 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:46.128 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:46.128 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:45 smithi184 ceph-mon[35007]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:58:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:46.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:45 smithi122 ceph-mon[34247]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:58:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:48.097 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:47 smithi083 ceph-mon[30926]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:47 smithi184 ceph-mon[35007]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:47 smithi122 ceph-mon[34247]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:49.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.284+0000 7f7c37fff640 1 -- 172.21.15.83:0/639743307 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c40062630 con 0x7f7c2c0a3410 2024-09-19T08:58:49.286 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 9 on host 'smithi083' 2024-09-19T08:58:49.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c2c0a3410 msgr2=0x7f7c2c0a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c2c0a3410 0x7f7c2c0a58d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c401993a0 tx=0x7f7c28005e50 comp rx=0 tx=0).stop 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 msgr2=0x7f7c40197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40197e80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c30005e30 tx=0x7f7c30003ba0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 shutdown_connections 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7c2c0a3410 0x7f7c2c0a58d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c401037c0 0x7f7c4019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c40102e00 0x7f7c401983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 --2- 172.21.15.83:0/639743307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c40101c00 0x7f7c40197e80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.287+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 >> 172.21.15.83:0/639743307 conn(0x7f7c400fd390 msgr2=0x7f7c401061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.288+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 shutdown_connections 2024-09-19T08:58:49.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:58:49.288+0000 7f7c454fd640 1 -- 172.21.15.83:0/639743307 wait complete. 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:49 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:49 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:49.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:49 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:49.964 DEBUG:teuthology.orchestra.run.smithi083:osd.9> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T08:58:49.967 INFO:tasks.cephadm:Deploying osd.10 on smithi122 with /dev/vg_nvme/lv_1... 2024-09-19T08:58:49.967 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:58:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:58:51.211 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 08:58:50 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T08:58:50.953+0000 7ff15ae87640 -1 osd.9 0 log_to_monitors true 2024-09-19T08:58:52.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:51 smithi122 ceph-mon[34247]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:52.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:51 smithi122 ceph-mon[34247]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:58:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:51 smithi083 ceph-mon[30926]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:51 smithi083 ceph-mon[30926]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:58:52.353 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:51 smithi184 ceph-mon[35007]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:52.353 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:51 smithi184 ceph-mon[35007]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:58:52.814 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-19T08:58:52.837 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_1 2024-09-19T08:58:53.091 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:58:53.169 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:52 smithi083 ceph-mon[30926]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:58:53.169 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:52 smithi083 ceph-mon[30926]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:58:53.169 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:52 smithi083 ceph-mon[30926]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:58:53.169 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:52 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:53.169 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 08:58:52 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T08:58:52.960+0000 7ff156e0a640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T08:58:53.169 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 08:58:52 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T08:58:52.970+0000 7ff152c32640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:52 smithi122 ceph-mon[34247]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:58:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:52 smithi122 ceph-mon[34247]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:58:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:52 smithi122 ceph-mon[34247]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:58:53.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:52 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:53.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:52 smithi184 ceph-mon[35007]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:58:53.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:52 smithi184 ceph-mon[35007]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:58:53.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:52 smithi184 ceph-mon[35007]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-09-19T08:58:53.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:52 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:53.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.589+0000 7f5b677b6640 1 -- 172.21.15.122:0/3253344103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b601026d0 msgr2=0x7f5b60108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.589+0000 7f5b677b6640 1 --2- 172.21.15.122:0/3253344103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b601026d0 0x7f5b60108f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009ca0 tx=0x7f5b5802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.589+0000 7f5b677b6640 1 -- 172.21.15.122:0/3253344103 shutdown_connections 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 --2- 172.21.15.122:0/3253344103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b601026d0 0x7f5b60108f60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 --2- 172.21.15.122:0/3253344103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b60101d10 0x7f5b60102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 --2- 172.21.15.122:0/3253344103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b60100b10 0x7f5b60100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 -- 172.21.15.122:0/3253344103 >> 172.21.15.122:0/3253344103 conn(0x7f5b600fc2a0 msgr2=0x7f5b600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 -- 172.21.15.122:0/3253344103 shutdown_connections 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 -- 172.21.15.122:0/3253344103 wait complete. 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 Processor -- start 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.590+0000 7f5b677b6640 1 -- start start 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 0x7f5b60196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b60101d10 0x7f5b601971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b601026d0 0x7f5b6019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010c640 con 0x7f5b601026d0 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010c4c0 con 0x7f5b60100b10 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010c7c0 con 0x7f5b60101d10 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 0x7f5b60196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 0x7f5b60196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:36048/0 (socket says 172.21.15.122:36048) 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 -- 172.21.15.122:0/1818849552 learned_addr learned my addr 172.21.15.122:0/1818849552 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b64d51640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b60101d10 0x7f5b601971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 -- 172.21.15.122:0/1818849552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b60101d10 msgr2=0x7f5b601971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b60101d10 0x7f5b601971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 -- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b601026d0 msgr2=0x7f5b6019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b601026d0 0x7f5b6019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 -- 172.21.15.122:0/1818849552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6019e890 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b65552640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 0x7f5b60196c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000c970 tx=0x7f5b5000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50007c10 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b50007db0 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6019eb80 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000f870 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.591+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6019f0c0 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.592+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b60107ec0 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.593+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5b5000fa10 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.594+0000 7f5b567fc640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5b4c0a3240 0x7f5b4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.594+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f5b500cf390 con 0x7f5b60100b10 2024-09-19T08:58:53.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.594+0000 7f5b64d51640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5b4c0a3240 0x7f5b4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.595+0000 7f5b64d51640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5b4c0a3240 0x7f5b4c0a5700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b60198180 tx=0x7f5b5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:53.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.598+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b5009ca60 con 0x7f5b60100b10 2024-09-19T08:58:53.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:58:53.775+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5b60062630 con 0x7f5b4c0a3240 2024-09-19T08:58:54.189 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:54.189 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:54.190 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.191 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:54.191 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:54.191 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:58:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:58:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:54.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:58:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-19T08:58:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:58:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:54.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi083 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] boot 2024-09-19T08:58:55.199 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:58:55.200 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:54 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:58:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:58:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi083 2024-09-19T08:58:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-19T08:58:55.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:55.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] boot 2024-09-19T08:58:55.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:58:55.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:54 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi083 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: osd.9 [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] boot 2024-09-19T08:58:55.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:58:55.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:54 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:58:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:55 smithi122 ceph-mon[34247]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:58:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:55 smithi122 ceph-mon[34247]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T08:58:56.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:55 smithi083 ceph-mon[30926]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:58:56.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:55 smithi083 ceph-mon[30926]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T08:58:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:55 smithi184 ceph-mon[35007]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:58:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:55 smithi184 ceph-mon[35007]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T08:58:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:56 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/878712785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]: dispatch 2024-09-19T08:58:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:56 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]: dispatch 2024-09-19T08:58:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:56 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]': finished 2024-09-19T08:58:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:56 smithi122 ceph-mon[34247]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:58:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:58:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:56 smithi122 ceph-mon[34247]: from='client.? 172.21.15.122:0/1068887992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:56 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/878712785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]: dispatch 2024-09-19T08:58:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:56 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]: dispatch 2024-09-19T08:58:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:56 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]': finished 2024-09-19T08:58:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:56 smithi184 ceph-mon[35007]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:58:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:58:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:56 smithi184 ceph-mon[35007]: from='client.? 172.21.15.122:0/1068887992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:56 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/878712785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]: dispatch 2024-09-19T08:58:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:56 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]: dispatch 2024-09-19T08:58:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:56 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e5cf625-8523-4410-b239-9f05ff594ffa"}]': finished 2024-09-19T08:58:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:56 smithi083 ceph-mon[30926]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:58:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:58:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:56 smithi083 ceph-mon[30926]: from='client.? 172.21.15.122:0/1068887992' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:57 smithi184 ceph-mon[35007]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:58:58.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:57 smithi122 ceph-mon[34247]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:58:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:57 smithi083 ceph-mon[30926]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:58:59 smithi184 ceph-mon[35007]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:00.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:58:59 smithi122 ceph-mon[34247]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:00.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:58:59 smithi083 ceph-mon[30926]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:02.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:01 smithi122 ceph-mon[34247]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:01 smithi184 ceph-mon[35007]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:01 smithi083 ceph-mon[30926]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:04.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:03 smithi184 ceph-mon[35007]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:04.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:03 smithi122 ceph-mon[34247]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:03 smithi083 ceph-mon[30926]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:05.301 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:04 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:59:05.301 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:04 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:04 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:59:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:04 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:05.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:04 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:59:05.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:04 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:06.148 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:05 smithi122 ceph-mon[34247]: Deploying daemon osd.10 on smithi122 2024-09-19T08:59:06.148 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:05 smithi122 ceph-mon[34247]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:05 smithi184 ceph-mon[35007]: Deploying daemon osd.10 on smithi122 2024-09-19T08:59:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:05 smithi184 ceph-mon[35007]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:05 smithi083 ceph-mon[30926]: Deploying daemon osd.10 on smithi122 2024-09-19T08:59:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:05 smithi083 ceph-mon[30926]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:08.161 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:07 smithi122 ceph-mon[34247]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:07 smithi184 ceph-mon[35007]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:08.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:07 smithi083 ceph-mon[30926]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:10.261 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:09 smithi122 ceph-mon[34247]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:09 smithi184 ceph-mon[35007]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:09 smithi083 ceph-mon[30926]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:11.257 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:11.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:11.258 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:10 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:10 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:10 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:12.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:11 smithi122 ceph-mon[34247]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:11 smithi184 ceph-mon[35007]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:11 smithi083 ceph-mon[30926]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:14.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:14 smithi083 ceph-mon[30926]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:14.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:14.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:14.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.272 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:14 smithi122 ceph-mon[34247]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:14.272 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.272 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.272 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:14.273 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:14.273 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.320 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 10 on host 'smithi122' 2024-09-19T08:59:14.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.319+0000 7f5b567fc640 1 -- 172.21.15.122:0/1818849552 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5b60062630 con 0x7f5b4c0a3240 2024-09-19T08:59:14.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5b4c0a3240 msgr2=0x7f5b4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:14.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5b4c0a3240 0x7f5b4c0a5700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b60198180 tx=0x7f5b5c005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:14.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 msgr2=0x7f5b60196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:14.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 0x7f5b60196c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000c970 tx=0x7f5b5000ce30 comp rx=0 tx=0).stop 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 shutdown_connections 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5b4c0a3240 0x7f5b4c0a5700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b601026d0 0x7f5b6019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b60101d10 0x7f5b601971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 --2- 172.21.15.122:0/1818849552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b60100b10 0x7f5b60196c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 >> 172.21.15.122:0/1818849552 conn(0x7f5b600fc2a0 msgr2=0x7f5b60105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 shutdown_connections 2024-09-19T08:59:14.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-19T08:59:14.322+0000 7f5b677b6640 1 -- 172.21.15.122:0/1818849552 wait complete. 2024-09-19T08:59:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:14 smithi184 ceph-mon[35007]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:14.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:14.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:14.989 DEBUG:teuthology.orchestra.run.smithi122:osd.10> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T08:59:14.991 INFO:tasks.cephadm:Deploying osd.11 on smithi184 with /dev/vg_nvme/lv_1... 2024-09-19T08:59:14.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:59:15.247 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:59:15.293 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:15.293 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:15.294 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:15 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:15.368 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:15.368 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:15.368 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:15 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:15 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:16.163 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:16 smithi122 ceph-mon[34247]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:16.341 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:16 smithi184 ceph-mon[35007]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:16 smithi083 ceph-mon[30926]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:16.692 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 08:59:16 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T08:59:16.414+0000 7fa41e9d6640 -1 osd.10 0 log_to_monitors true 2024-09-19T08:59:17.088 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:17 smithi184 ceph-mon[35007]: from='osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:59:17.088 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:17 smithi184 ceph-mon[35007]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:59:17.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:17 smithi122 ceph-mon[34247]: from='osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:59:17.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:17 smithi122 ceph-mon[34247]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:59:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:17 smithi083 ceph-mon[30926]: from='osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:59:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:17 smithi083 ceph-mon[30926]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:59:18.210 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T08:59:18.023+0000 7fa41a959640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T08:59:18.210 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T08:59:18.032+0000 7fa416781640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:18.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:18 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:59:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:59:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:59:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:18 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.423 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-19T08:59:18.449 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_1 2024-09-19T08:59:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:59:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:59:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:59:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:18 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:18.698 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi122 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi122 to 4271M 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:19.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:19 smithi184 ceph-mon[35007]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2512539409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 msgr2=0x7f8ba4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2512539409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4107420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009900 tx=0x7f8b8c02a410 comp rx=0 tx=0).stop 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2512539409 shutdown_connections 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2512539409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba4107960 0x7f8ba4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2512539409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4107420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2512539409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 0x7f8ba4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2512539409 >> 172.21.15.184:0/2512539409 conn(0x7f8ba40fc280 msgr2=0x7f8ba40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2512539409 shutdown_connections 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2512539409 wait complete. 2024-09-19T08:59:19.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 Processor -- start 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 -- start start 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.195+0000 7f8ba92f4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 0x7f8ba4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba4107960 0x7f8ba419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba410d6e0 con 0x7f8ba4102700 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba410d560 con 0x7f8ba4107960 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba410d860 con 0x7f8ba4105030 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42106/0 (socket says 172.21.15.184:42106) 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 -- 172.21.15.184:0/2333646552 learned_addr learned my addr 172.21.15.184:0/2333646552 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba2ffd640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 0x7f8ba4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 -- 172.21.15.184:0/2333646552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba4107960 msgr2=0x7f8ba419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:19.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba4107960 0x7f8ba419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 -- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 msgr2=0x7f8ba4197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 0x7f8ba4197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 -- 172.21.15.184:0/2333646552 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba419fa80 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba2ffd640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 0x7f8ba4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba27fc640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4198390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0314e0 tx=0x7f8b8c031a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c03f030 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba419fd10 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b8c0044b0 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c035070 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.196+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba41a01e0 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.197+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba40fdd70 con 0x7f8ba4105030 2024-09-19T08:59:19.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.199+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8b8c042030 con 0x7f8ba4105030 2024-09-19T08:59:19.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.200+0000 7f8b9bfff640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8b900a3270 0x7f8b900a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:19.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.200+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6727+0+0 (secure 0 0 0) 0x7f8b8c0efdb0 con 0x7f8ba4105030 2024-09-19T08:59:19.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.200+0000 7f8ba2ffd640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8b900a3270 0x7f8b900a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:19.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.201+0000 7f8ba2ffd640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8b900a3270 0x7f8b900a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b94005c40 tx=0x7f8b940082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:19.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.203+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b8c0bd220 con 0x7f8ba4105030 2024-09-19T08:59:19.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:19.378+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8ba4062630 con 0x7f8b900a3270 2024-09-19T08:59:19.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi122 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi122 to 4271M 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:19 smithi122 ceph-mon[34247]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:19.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi122 2024-09-19T08:59:19.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi122 to 4271M 2024-09-19T08:59:19.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-19T08:59:19.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T08:59:19.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:19.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:19.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:19 smithi083 ceph-mon[30926]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] boot 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:20.058 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:20.059 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:20.059 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:20.059 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:20 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:59:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:59:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] boot 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:20 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:59:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: osd.10 [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] boot 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:20.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:20 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:21.230 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:21 smithi184 ceph-mon[35007]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:59:21.230 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:21 smithi184 ceph-mon[35007]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:21.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:21 smithi122 ceph-mon[34247]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:59:21.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:21 smithi122 ceph-mon[34247]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:21.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:21 smithi083 ceph-mon[30926]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:59:21.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:21 smithi083 ceph-mon[30926]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:22.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:22 smithi184 ceph-mon[35007]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T08:59:22.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:22 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/2999645616' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]: dispatch 2024-09-19T08:59:22.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:22 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]: dispatch 2024-09-19T08:59:22.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:22 smithi184 ceph-mon[35007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]': finished 2024-09-19T08:59:22.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:22 smithi184 ceph-mon[35007]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:59:22.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:22 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:22.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:22 smithi122 ceph-mon[34247]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T08:59:22.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:22 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/2999645616' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]: dispatch 2024-09-19T08:59:22.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:22 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]: dispatch 2024-09-19T08:59:22.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:22 smithi122 ceph-mon[34247]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]': finished 2024-09-19T08:59:22.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:22 smithi122 ceph-mon[34247]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:59:22.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:22 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:22 smithi083 ceph-mon[30926]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T08:59:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:22 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/2999645616' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]: dispatch 2024-09-19T08:59:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:22 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]: dispatch 2024-09-19T08:59:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:22 smithi083 ceph-mon[30926]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "617cb685-6467-46dc-95a8-9e7cace13cb9"}]': finished 2024-09-19T08:59:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:22 smithi083 ceph-mon[30926]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:59:22.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:22 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:23.303 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:23 smithi184 ceph-mon[35007]: from='client.? 172.21.15.184:0/1591534832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:23.304 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:23 smithi184 ceph-mon[35007]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:23.304 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:23 smithi184 ceph-mon[35007]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:59:23.304 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:23.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:23 smithi122 ceph-mon[34247]: from='client.? 172.21.15.184:0/1591534832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:23.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:23 smithi122 ceph-mon[34247]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:23.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:23 smithi122 ceph-mon[34247]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:59:23.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:23.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:23 smithi083 ceph-mon[30926]: from='client.? 172.21.15.184:0/1591534832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:23.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:23 smithi083 ceph-mon[30926]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:23.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:23 smithi083 ceph-mon[30926]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:59:23.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:26.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:25 smithi122 ceph-mon[34247]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-19T08:59:26.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:25 smithi083 ceph-mon[30926]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-19T08:59:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:25 smithi184 ceph-mon[35007]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-19T08:59:28.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:27 smithi122 ceph-mon[34247]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:59:28.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:27 smithi083 ceph-mon[30926]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:59:28.261 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:27 smithi184 ceph-mon[35007]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:59:30.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:29 smithi122 ceph-mon[34247]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T08:59:30.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:29 smithi083 ceph-mon[30926]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T08:59:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:29 smithi184 ceph-mon[35007]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T08:59:31.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:59:31.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:30 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:31.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:59:31.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:30 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:31.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:59:31.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:30 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.266 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:31 smithi184 ceph-mon[35007]: Deploying daemon osd.11 on smithi184 2024-09-19T08:59:32.266 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:31 smithi184 ceph-mon[35007]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:59:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:31 smithi122 ceph-mon[34247]: Deploying daemon osd.11 on smithi184 2024-09-19T08:59:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:31 smithi122 ceph-mon[34247]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:59:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:31 smithi083 ceph-mon[30926]: Deploying daemon osd.11 on smithi184 2024-09-19T08:59:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:31 smithi083 ceph-mon[30926]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T08:59:34.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:33 smithi184 ceph-mon[35007]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:59:34.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:33 smithi122 ceph-mon[34247]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:59:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:33 smithi083 ceph-mon[30926]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:59:36.362 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:35 smithi184 ceph-mon[35007]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:59:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:35 smithi122 ceph-mon[34247]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:59:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:35 smithi083 ceph-mon[30926]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:59:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:37 smithi184 ceph-mon[35007]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:38.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:38.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:37 smithi122 ceph-mon[34247]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:37 smithi083 ceph-mon[30926]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:39 smithi184 ceph-mon[35007]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:40.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:40.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:40.111 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:39 smithi122 ceph-mon[34247]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:39 smithi083 ceph-mon[30926]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:40.462 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.462+0000 7f8b9bfff640 1 -- 172.21.15.184:0/2333646552 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f8ba4062630 con 0x7f8b900a3270 2024-09-19T08:59:40.462 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 11 on host 'smithi184' 2024-09-19T08:59:40.464 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8b900a3270 msgr2=0x7f8b900a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:40.464 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8b900a3270 0x7f8b900a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b94005c40 tx=0x7f8b940082f0 comp rx=0 tx=0).stop 2024-09-19T08:59:40.464 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 msgr2=0x7f8ba4198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:40.464 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4198390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0314e0 tx=0x7f8b8c031a30 comp rx=0 tx=0).stop 2024-09-19T08:59:40.464 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 shutdown_connections 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8b900a3270 0x7f8b900a5730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba4107960 0x7f8ba419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba4105030 0x7f8ba4198390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 --2- 172.21.15.184:0/2333646552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ba4102700 0x7f8ba4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.464+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 >> 172.21.15.184:0/2333646552 conn(0x7f8ba40fc280 msgr2=0x7f8ba4102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.465+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 shutdown_connections 2024-09-19T08:59:40.465 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:40.465+0000 7f8ba92f4640 1 -- 172.21.15.184:0/2333646552 wait complete. 2024-09-19T08:59:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:41.207 DEBUG:teuthology.orchestra.run.smithi184:osd.11> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T08:59:41.209 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T08:59:41.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:59:41.237 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:41.237 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:41.237 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:41.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:41.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:41.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:41.465 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 -- 172.21.15.83:0/96504168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac101d10 msgr2=0x7fa8ac102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 --2- 172.21.15.83:0/96504168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac101d10 0x7fa8ac102190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009900 tx=0x7fa89c02a410 comp rx=0 tx=0).stop 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 -- 172.21.15.83:0/96504168 shutdown_connections 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 --2- 172.21.15.83:0/96504168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8ac1026d0 0x7fa8ac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 --2- 172.21.15.83:0/96504168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac101d10 0x7fa8ac102190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 --2- 172.21.15.83:0/96504168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8ac100b10 0x7fa8ac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 -- 172.21.15.83:0/96504168 >> 172.21.15.83:0/96504168 conn(0x7fa8ac0fc2a0 msgr2=0x7fa8ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 -- 172.21.15.83:0/96504168 shutdown_connections 2024-09-19T08:59:41.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 -- 172.21.15.83:0/96504168 wait complete. 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.952+0000 7fa8b1903640 1 Processor -- start 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 -- start start 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 0x7fa8ac196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8ac101d10 0x7fa8ac1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8ac1026d0 0x7fa8ac19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac10c6a0 con 0x7fa8ac100b10 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac10c520 con 0x7fa8ac101d10 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b1903640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac10c820 con 0x7fa8ac1026d0 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 0x7fa8ac196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 0x7fa8ac196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36588/0 (socket says 172.21.15.83:36588) 2024-09-19T08:59:41.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 -- 172.21.15.83:0/4120130762 learned_addr learned my addr 172.21.15.83:0/4120130762 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8ab7fe640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8ac1026d0 0x7fa8ac19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aa7fc640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8ac101d10 0x7fa8ac1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 -- 172.21.15.83:0/4120130762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8ac1026d0 msgr2=0x7fa8ac19e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8ac1026d0 0x7fa8ac19e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 -- 172.21.15.83:0/4120130762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8ac101d10 msgr2=0x7fa8ac1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8ac101d10 0x7fa8ac1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 -- 172.21.15.83:0/4120130762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac19e9d0 con 0x7fa8ac100b10 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8aaffd640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 0x7fa8ac196db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c970 tx=0x7fa8a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.953+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0004220 con 0x7fa8ac100b10 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.954+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8a00043c0 con 0x7fa8ac100b10 2024-09-19T08:59:41.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.954+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ac19ecc0 con 0x7fa8ac100b10 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.954+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000f450 con 0x7fa8ac100b10 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.954+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ac19f220 con 0x7fa8ac100b10 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.955+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ac107f60 con 0x7fa8ac100b10 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.956+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa8a00079b0 con 0x7fa8ac100b10 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.956+0000 7fa8b0901640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8940a32c0 0x7fa8940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.956+0000 7fa8aa7fc640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8940a32c0 0x7fa8940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.956+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7fa8a00cefa0 con 0x7fa8ac100b10 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.957+0000 7fa8aa7fc640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8940a32c0 0x7fa8940a5780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa89c000c00 tx=0x7fa89c005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:41.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:41.961+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8a0014030 con 0x7fa8ac100b10 2024-09-19T08:59:42.116 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:41 smithi184 ceph-mon[35007]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:42.128 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:41 smithi083 ceph-mon[30926]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.128+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa8ac02da50 con 0x7fa8ac100b10 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.128+0000 7fa8b0901640 1 -- 172.21.15.83:0/4120130762 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fa8a009bc50 con 0x7fa8ac100b10 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8940a32c0 msgr2=0x7fa8940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8940a32c0 0x7fa8940a5780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa89c000c00 tx=0x7fa89c005e40 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 msgr2=0x7fa8ac196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 0x7fa8ac196db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c970 tx=0x7fa8a000ce30 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 shutdown_connections 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8940a32c0 0x7fa8940a5780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8ac1026d0 0x7fa8ac19e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8ac101d10 0x7fa8ac1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 --2- 172.21.15.83:0/4120130762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa8ac100b10 0x7fa8ac196db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 >> 172.21.15.83:0/4120130762 conn(0x7fa8ac0fc2a0 msgr2=0x7fa8ac105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 shutdown_connections 2024-09-19T08:59:42.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:42.130+0000 7fa8b1903640 1 -- 172.21.15.83:0/4120130762 wait complete. 2024-09-19T08:59:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:41 smithi122 ceph-mon[34247]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:42.946 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726736359,"num_in_osds":12,"osd_in_since":1726736361,"num_remapped_pgs":0} 2024-09-19T08:59:42.986 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 08:59:42 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T08:59:42.808+0000 7fe45928b640 -1 osd.11 0 log_to_monitors true 2024-09-19T08:59:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:42 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4120130762' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:42 smithi083 ceph-mon[30926]: from='osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:59:43.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:42 smithi083 ceph-mon[30926]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:59:43.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:42 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4120130762' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:43.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:42 smithi184 ceph-mon[35007]: from='osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:59:43.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:42 smithi184 ceph-mon[35007]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:59:43.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:42 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4120130762' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:43.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:42 smithi122 ceph-mon[34247]: from='osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:59:43.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:42 smithi122 ceph-mon[34247]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:59:43.948 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:59:44.205 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:44.326 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:43 smithi083 ceph-mon[30926]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:44.327 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:43 smithi083 ceph-mon[30926]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:59:44.327 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:43 smithi083 ceph-mon[30926]: from='osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:59:44.327 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:43 smithi083 ceph-mon[30926]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:59:44.327 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:44.327 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:43 smithi083 ceph-mon[30926]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:59:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-mon[35007]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-mon[35007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:59:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-mon[35007]: from='osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:59:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-mon[35007]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:59:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-mon[35007]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:59:44.400 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 08:59:43 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T08:59:43.998+0000 7fe45520e640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T08:59:44.400 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 08:59:44 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T08:59:44.009+0000 7fe451036640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:59:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:43 smithi122 ceph-mon[34247]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:43 smithi122 ceph-mon[34247]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:59:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:43 smithi122 ceph-mon[34247]: from='osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:59:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:43 smithi122 ceph-mon[34247]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:59:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:43 smithi122 ceph-mon[34247]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-19T08:59:44.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 -- 172.21.15.83:0/1790634497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590101d10 msgr2=0x7f5590102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 --2- 172.21.15.83:0/1790634497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590101d10 0x7f5590102190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f558c009900 tx=0x7f558c02a410 comp rx=0 tx=0).stop 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 -- 172.21.15.83:0/1790634497 shutdown_connections 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 --2- 172.21.15.83:0/1790634497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55901026d0 0x7f5590108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 --2- 172.21.15.83:0/1790634497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590101d10 0x7f5590102190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 --2- 172.21.15.83:0/1790634497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5590100b10 0x7f5590100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 -- 172.21.15.83:0/1790634497 >> 172.21.15.83:0/1790634497 conn(0x7f55900fc2a0 msgr2=0x7f55900fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 -- 172.21.15.83:0/1790634497 shutdown_connections 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 -- 172.21.15.83:0/1790634497 wait complete. 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.762+0000 7f55980ac640 1 Processor -- start 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 -- start start 2024-09-19T08:59:44.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 0x7f5590196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5590101d10 0x7f55901972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55901026d0 0x7f559019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f559010c620 con 0x7f5590100b10 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f559010c4a0 con 0x7f55901026d0 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f55980ac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f559010c7a0 con 0x7f5590101d10 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 0x7f5590196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 0x7f5590196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36606/0 (socket says 172.21.15.83:36606) 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 -- 172.21.15.83:0/3709923428 learned_addr learned my addr 172.21.15.83:0/3709923428 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595647640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5590101d10 0x7f55901972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 -- 172.21.15.83:0/3709923428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5590101d10 msgr2=0x7f55901972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5590101d10 0x7f55901972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 -- 172.21.15.83:0/3709923428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55901026d0 msgr2=0x7f559019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5596649640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55901026d0 0x7f559019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55901026d0 0x7f559019e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 -- 172.21.15.83:0/3709923428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559019e990 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5595e48640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 0x7f5590196d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f558400d770 tx=0x7f558400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.763+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584017070 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.764+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5584009c30 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.764+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584003d00 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.764+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559019ec80 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.764+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559019f1c0 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.764+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5590107fa0 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.766+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5584003ea0 con 0x7f5590100b10 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.766+0000 7f5582ffd640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f557c0a3270 0x7f557c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:44.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.766+0000 7f5595647640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f557c0a3270 0x7f557c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:44.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.766+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7f55840ced60 con 0x7f5590100b10 2024-09-19T08:59:44.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.767+0000 7f5595647640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f557c0a3270 0x7f557c0a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5590198280 tx=0x7f558c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:44.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.770+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f558409c040 con 0x7f5590100b10 2024-09-19T08:59:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.937+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5590062df0 con 0x7f5590100b10 2024-09-19T08:59:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.937+0000 7f5582ffd640 1 -- 172.21.15.83:0/3709923428 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f558409b940 con 0x7f5590100b10 2024-09-19T08:59:44.937 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:59:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f557c0a3270 msgr2=0x7f557c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f557c0a3270 0x7f557c0a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5590198280 tx=0x7f558c0314a0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 msgr2=0x7f5590196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 0x7f5590196d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f558400d770 tx=0x7f558400dc30 comp rx=0 tx=0).stop 2024-09-19T08:59:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 shutdown_connections 2024-09-19T08:59:44.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f557c0a3270 0x7f557c0a5730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55901026d0 0x7f559019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5590101d10 0x7f55901972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 --2- 172.21.15.83:0/3709923428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5590100b10 0x7f5590196d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 >> 172.21.15.83:0/3709923428 conn(0x7f55900fc2a0 msgr2=0x7f5590105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 shutdown_connections 2024-09-19T08:59:44.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:44.940+0000 7f55980ac640 1 -- 172.21.15.83:0/3709923428 wait complete. 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:45 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3709923428' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:59:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T08:59:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:45 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3709923428' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-19T08:59:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T08:59:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:45 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3709923428' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:45.679 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726736359,"num_in_osds":12,"osd_in_since":1726736361,"num_remapped_pgs":0} 2024-09-19T08:59:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: purged_snaps scrub starts 2024-09-19T08:59:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: purged_snaps scrub ok 2024-09-19T08:59:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: Detected new or changed devices on smithi184 2024-09-19T08:59:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi184 to 4272M 2024-09-19T08:59:46.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:46.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] boot 2024-09-19T08:59:46.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:59:46.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:46 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: purged_snaps scrub starts 2024-09-19T08:59:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: purged_snaps scrub ok 2024-09-19T08:59:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: Detected new or changed devices on smithi184 2024-09-19T08:59:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi184 to 4272M 2024-09-19T08:59:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:46.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] boot 2024-09-19T08:59:46.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:59:46.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:46 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:46.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: purged_snaps scrub starts 2024-09-19T08:59:46.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: purged_snaps scrub ok 2024-09-19T08:59:46.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: Detected new or changed devices on smithi184 2024-09-19T08:59:46.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi184 to 4272M 2024-09-19T08:59:46.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:59:46.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: osd.11 [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] boot 2024-09-19T08:59:46.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:59:46.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:46 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:59:46.681 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:59:46.934 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:47.383 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:47 smithi083 ceph-mon[30926]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:59:47.383 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:47 smithi083 ceph-mon[30926]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:47.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:47 smithi184 ceph-mon[35007]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:59:47.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:47 smithi184 ceph-mon[35007]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:47.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:47 smithi122 ceph-mon[34247]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:59:47.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:47 smithi122 ceph-mon[34247]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:47.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 -- 172.21.15.83:0/2136103580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44401037c0 msgr2=0x7f444010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 --2- 172.21.15.83:0/2136103580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44401037c0 0x7f444010a050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4438009ca0 tx=0x7f443802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 -- 172.21.15.83:0/2136103580 shutdown_connections 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 --2- 172.21.15.83:0/2136103580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44401037c0 0x7f444010a050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 --2- 172.21.15.83:0/2136103580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4440102e00 0x7f4440103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 --2- 172.21.15.83:0/2136103580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4440101c00 0x7f4440102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 -- 172.21.15.83:0/2136103580 >> 172.21.15.83:0/2136103580 conn(0x7f44400fd390 msgr2=0x7f44400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 -- 172.21.15.83:0/2136103580 shutdown_connections 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 -- 172.21.15.83:0/2136103580 wait complete. 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 Processor -- start 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.461+0000 7f444862b640 1 -- start start 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4440101c00 0x7f444019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 0x7f444019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44401037c0 0x7f44401a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f444010d790 con 0x7f4440102e00 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f444010d610 con 0x7f4440101c00 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f444010d910 con 0x7f44401037c0 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 0x7f444019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 0x7f444019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36632/0 (socket says 172.21.15.83:36632) 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 -- 172.21.15.83:0/1065592975 learned_addr learned my addr 172.21.15.83:0/1065592975 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4446bc8640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44401037c0 0x7f44401a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f44463c7640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4440101c00 0x7f444019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 -- 172.21.15.83:0/1065592975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44401037c0 msgr2=0x7f44401a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44401037c0 0x7f44401a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 -- 172.21.15.83:0/1065592975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4440101c00 msgr2=0x7f444019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4440101c00 0x7f444019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 -- 172.21.15.83:0/1065592975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44401a1ca0 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f4445bc6640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 0x7f444019a5b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f443c00b4a0 tx=0x7f443c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c014070 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f443c010ac0 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44401a1f90 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c017c30 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.462+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44401a2440 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.463+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44401a26d0 con 0x7f4440102e00 2024-09-19T08:59:47.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.465+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f443c017070 con 0x7f4440102e00 2024-09-19T08:59:47.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.466+0000 7f44337fe640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f442c0a3270 0x7f442c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.466+0000 7f44463c7640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f442c0a3270 0x7f442c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.466+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f443c0cec10 con 0x7f4440102e00 2024-09-19T08:59:47.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.466+0000 7f44463c7640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f442c0a3270 0x7f442c0a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4440102c60 tx=0x7f4434005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:47.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.469+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f443c09bdd0 con 0x7f4440102e00 2024-09-19T08:59:47.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.636+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f44401a2940 con 0x7f4440102e00 2024-09-19T08:59:47.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.637+0000 7f44337fe640 1 -- 172.21.15.83:0/1065592975 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f443c09b6d0 con 0x7f4440102e00 2024-09-19T08:59:47.637 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f442c0a3270 msgr2=0x7f442c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f442c0a3270 0x7f442c0a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4440102c60 tx=0x7f4434005c60 comp rx=0 tx=0).stop 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 msgr2=0x7f444019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 0x7f444019a5b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f443c00b4a0 tx=0x7f443c00b960 comp rx=0 tx=0).stop 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 shutdown_connections 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f442c0a3270 0x7f442c0a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44401037c0 0x7f44401a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4440102e00 0x7f444019a5b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 --2- 172.21.15.83:0/1065592975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4440101c00 0x7f444019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 >> 172.21.15.83:0/1065592975 conn(0x7f44400fd390 msgr2=0x7f44401085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:47.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 shutdown_connections 2024-09-19T08:59:47.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:47.639+0000 7f444862b640 1 -- 172.21.15.83:0/1065592975 wait complete. 2024-09-19T08:59:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:48 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1065592975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:48 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1065592975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:48.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:48 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1065592975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:59:48.507 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726736384,"num_in_osds":12,"osd_in_since":1726736361,"num_remapped_pgs":0} 2024-09-19T08:59:48.508 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:59:48.746 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 -- 172.21.15.83:0/3498896036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 msgr2=0x7ff82410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 --2- 172.21.15.83:0/3498896036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff82410d8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ca0 tx=0x7ff81c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 -- 172.21.15.83:0/3498896036 shutdown_connections 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 --2- 172.21.15.83:0/3498896036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff82410d8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 --2- 172.21.15.83:0/3498896036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824101220 0x7ff824101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 --2- 172.21.15.83:0/3498896036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824105a70 0x7ff824105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 -- 172.21.15.83:0/3498896036 >> 172.21.15.83:0/3498896036 conn(0x7ff8240fbee0 msgr2=0x7ff8240fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 -- 172.21.15.83:0/3498896036 shutdown_connections 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 -- 172.21.15.83:0/3498896036 wait complete. 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 Processor -- start 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.240+0000 7ff82ad54640 1 -- start start 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824101220 0x7ff824196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff824197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824105a70 0x7ff824197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff824110e40 con 0x7ff824101ba0 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff824110cc0 con 0x7ff824105a70 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff824110fc0 con 0x7ff824101220 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff824197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff824197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36658/0 (socket says 172.21.15.83:36658) 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 -- 172.21.15.83:0/2785385153 learned_addr learned my addr 172.21.15.83:0/2785385153 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:49.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff828af0640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824101220 0x7ff824196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff8292f1640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824105a70 0x7ff824197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 -- 172.21.15.83:0/2785385153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824101220 msgr2=0x7ff824196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824101220 0x7ff824196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 -- 172.21.15.83:0/2785385153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824105a70 msgr2=0x7ff824197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824105a70 0x7ff824197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 -- 172.21.15.83:0/2785385153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8241a6850 con 0x7ff824101ba0 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff828af0640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824101220 0x7ff824196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff8292f1640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824105a70 0x7ff824197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff823fff640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff824197520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff81000b4a0 tx=0x7ff81000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810014070 con 0x7ff824101ba0 2024-09-19T08:59:49.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8241a6b40 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff810010ac0 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.241+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810017c30 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.242+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8241a7080 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.243+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff824101660 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.244+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff810017070 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.244+0000 7ff821ffb640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff8140a3240 0x7ff8140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.245+0000 7ff828af0640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff8140a3240 0x7ff8140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.245+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff8100cebf0 con 0x7ff824101ba0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.245+0000 7ff828af0640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff8140a3240 0x7ff8140a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff81800abe0 tx=0x7ff81800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.249+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff81009bdb0 con 0x7ff824101ba0 2024-09-19T08:59:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:49 smithi184 ceph-mon[35007]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:49.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.417+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8241a7310 con 0x7ff824101ba0 2024-09-19T08:59:49.417 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:49 smithi083 ceph-mon[30926]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.418+0000 7ff821ffb640 1 -- 172.21.15.83:0/2785385153 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18494 (secure 0 0 0) 0x7ff81009b6b0 con 0x7ff824101ba0 2024-09-19T08:59:49.418 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:59:49.418 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":76,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T08:59:46.109847+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:59:49.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff8140a3240 msgr2=0x7ff8140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff8140a3240 0x7ff8140a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff81800abe0 tx=0x7ff81800a5c0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 msgr2=0x7ff824197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff824197520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff81000b4a0 tx=0x7ff81000b960 comp rx=0 tx=0).stop 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 shutdown_connections 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff8140a3240 0x7ff8140a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff824105a70 0x7ff824197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff824101ba0 0x7ff824197520 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 --2- 172.21.15.83:0/2785385153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff824101220 0x7ff824196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 >> 172.21.15.83:0/2785385153 conn(0x7ff8240fbee0 msgr2=0x7ff8240fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 shutdown_connections 2024-09-19T08:59:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:49.421+0000 7ff82ad54640 1 -- 172.21.15.83:0/2785385153 wait complete. 2024-09-19T08:59:49.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:49 smithi122 ceph-mon[34247]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:50.255 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:55:57.133143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:59:50.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:59:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:50 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2785385153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:59:50.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:50 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2785385153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:59:50.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:50 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2785385153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:59:50.499 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 -- 172.21.15.83:0/3874492049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8102ef0 msgr2=0x7f46d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 --2- 172.21.15.83:0/3874492049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8102ef0 0x7f46d810da40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ca0 tx=0x7f46d002a950 comp rx=0 tx=0).stop 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 -- 172.21.15.83:0/3874492049 shutdown_connections 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 --2- 172.21.15.83:0/3874492049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8102ef0 0x7f46d810da40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 --2- 172.21.15.83:0/3874492049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46d8102570 0x7f46d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 --2- 172.21.15.83:0/3874492049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8100e20 0x7f46d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 -- 172.21.15.83:0/3874492049 >> 172.21.15.83:0/3874492049 conn(0x7f46d80fc7d0 msgr2=0x7f46d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 -- 172.21.15.83:0/3874492049 shutdown_connections 2024-09-19T08:59:51.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 -- 172.21.15.83:0/3874492049 wait complete. 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 Processor -- start 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.987+0000 7f46de624640 1 -- start start 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 0x7f46d8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8102570 0x7f46d8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46d8102ef0 0x7f46d819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46d8111fd0 con 0x7f46d8100e20 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f46d8111e50 con 0x7f46d8102570 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f46d8112150 con 0x7f46d8102ef0 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 0x7f46d8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 0x7f46d8198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46704/0 (socket says 172.21.15.83:46704) 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 -- 172.21.15.83:0/3779406950 learned_addr learned my addr 172.21.15.83:0/3779406950 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:51.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46dcbc1640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46d8102ef0 0x7f46d819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 -- 172.21.15.83:0/3779406950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46d8102ef0 msgr2=0x7f46d819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46d8102ef0 0x7f46d819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 -- 172.21.15.83:0/3779406950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8102570 msgr2=0x7f46d8198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46cffff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8102570 0x7f46d8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8102570 0x7f46d8198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 -- 172.21.15.83:0/3779406950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d819d4e0 con 0x7f46d8100e20 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46cffff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8102570 0x7f46d8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d7fff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 0x7f46d8198530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46c800b4a0 tx=0x7f46c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8014070 con 0x7f46d8100e20 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d819d7d0 con 0x7f46d8100e20 2024-09-19T08:59:51.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46c8010ac0 con 0x7f46d8100e20 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8017c30 con 0x7f46d8100e20 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.988+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d81a50b0 con 0x7f46d8100e20 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.989+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d8101280 con 0x7f46d8100e20 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.990+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f46c8017070 con 0x7f46d8100e20 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.991+0000 7f46d5ffb640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f46c40a3240 0x7f46c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.991+0000 7f46cffff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f46c40a3240 0x7f46c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.991+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f46c80cec00 con 0x7f46d8100e20 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.991+0000 7f46cffff640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f46c40a3240 0x7f46c40a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46c0006fd0 tx=0x7f46c0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:51.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:50.995+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46c80d5080 con 0x7f46d8100e20 2024-09-19T08:59:51.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.164+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f46d8109090 con 0x7f46d8100e20 2024-09-19T08:59:51.164 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:51 smithi083 ceph-mon[30926]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:51.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.164+0000 7f46d5ffb640 1 -- 172.21.15.83:0/3779406950 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f46c809bdc0 con 0x7f46d8100e20 2024-09-19T08:59:51.165 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-09-19T08:59:51.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.166+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f46c40a3240 msgr2=0x7f46c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.166+0000 7f46de624640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f46c40a3240 0x7f46c40a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46c0006fd0 tx=0x7f46c0008040 comp rx=0 tx=0).stop 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.166+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 msgr2=0x7f46d8198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.166+0000 7f46de624640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 0x7f46d8198530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46c800b4a0 tx=0x7f46c800b960 comp rx=0 tx=0).stop 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 shutdown_connections 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f46c40a3240 0x7f46c40a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46d8102ef0 0x7f46d819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46d8102570 0x7f46d8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 --2- 172.21.15.83:0/3779406950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46d8100e20 0x7f46d8198530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 >> 172.21.15.83:0/3779406950 conn(0x7f46d80fc7d0 msgr2=0x7f46d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 shutdown_connections 2024-09-19T08:59:51.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:51.167+0000 7f46de624640 1 -- 172.21.15.83:0/3779406950 wait complete. 2024-09-19T08:59:51.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:51 smithi184 ceph-mon[35007]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:51.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:51 smithi122 ceph-mon[34247]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:51.893 INFO:tasks.cephadm:Adding mds.a on smithi083 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.d on smithi083 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.g on smithi083 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.j on smithi083 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.b on smithi122 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.e on smithi122 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.h on smithi122 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.k on smithi122 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.c on smithi184 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.f on smithi184 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.i on smithi184 2024-09-19T08:59:51.894 INFO:tasks.cephadm:Adding mds.l on smithi184 2024-09-19T08:59:51.895 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l' 2024-09-19T08:59:52.157 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:59:52.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:52 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3779406950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:59:52.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:52 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3779406950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:59:52.460 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:52 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3779406950' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:59:52.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.682+0000 7fef880c5640 1 -- 172.21.15.184:0/554190470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 msgr2=0x7fef80109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.706 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.682+0000 7fef880c5640 1 --2- 172.21.15.184:0/554190470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80109d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef78009ca0 tx=0x7fef7802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.706 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- 172.21.15.184:0/554190470 shutdown_connections 2024-09-19T08:59:52.706 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 --2- 172.21.15.184:0/554190470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80109d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.706 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 --2- 172.21.15.184:0/554190470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef80104ff0 0x7fef801073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.707 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 --2- 172.21.15.184:0/554190470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef801026c0 0x7fef80104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.707 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- 172.21.15.184:0/554190470 >> 172.21.15.184:0/554190470 conn(0x7fef800fc280 msgr2=0x7fef800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:52.707 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- 172.21.15.184:0/554190470 shutdown_connections 2024-09-19T08:59:52.707 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- 172.21.15.184:0/554190470 wait complete. 2024-09-19T08:59:52.707 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 Processor -- start 2024-09-19T08:59:52.707 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- start start 2024-09-19T08:59:52.708 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef801026c0 0x7fef80102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.708 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef80104ff0 0x7fef80100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.708 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.708 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010d730 con 0x7fef801026c0 2024-09-19T08:59:52.708 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010d5b0 con 0x7fef80104ff0 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.683+0000 7fef880c5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010d8b0 con 0x7fef80107920 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37424/0 (socket says 172.21.15.184:37424) 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 -- 172.21.15.184:0/3232925449 learned_addr learned my addr 172.21.15.184:0/3232925449 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef85e61640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef801026c0 0x7fef80102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef85660640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef80104ff0 0x7fef80100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.709 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 -- 172.21.15.184:0/3232925449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef80104ff0 msgr2=0x7fef80100670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.710 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef80104ff0 0x7fef80100670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.710 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 -- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef801026c0 msgr2=0x7fef80102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.710 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef801026c0 0x7fef80102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.710 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 -- 172.21.15.184:0/3232925449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef80101470 con 0x7fef80107920 2024-09-19T08:59:52.710 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef86662640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80100bb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef78009dc0 tx=0x7fef78003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:52.710 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78004040 con 0x7fef80107920 2024-09-19T08:59:52.711 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef78004690 con 0x7fef80107920 2024-09-19T08:59:52.711 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef801a1ec0 con 0x7fef80107920 2024-09-19T08:59:52.711 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7802f4c0 con 0x7fef80107920 2024-09-19T08:59:52.711 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.684+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801a2370 con 0x7fef80107920 2024-09-19T08:59:52.711 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.685+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef800fdd70 con 0x7fef80107920 2024-09-19T08:59:52.711 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.687+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fef780305c0 con 0x7fef80107920 2024-09-19T08:59:52.712 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.687+0000 7fef76ffd640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fef6c0a32c0 0x7fef6c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.712 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.687+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fef780f0c40 con 0x7fef80107920 2024-09-19T08:59:52.712 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.688+0000 7fef85e61640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fef6c0a32c0 0x7fef6c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.712 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.688+0000 7fef85e61640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fef6c0a32c0 0x7fef6c0a5780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0058c0 tx=0x7fef7c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:52.712 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.690+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef780bde00 con 0x7fef80107920 2024-09-19T08:59:52.871 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.871+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}) -- 0x7fef80062730 con 0x7fef6c0a32c0 2024-09-19T08:59:52.879 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.879+0000 7fef76ffd640 1 -- 172.21.15.184:0/3232925449 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fef80062730 con 0x7fef6c0a32c0 2024-09-19T08:59:52.879 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mds.all update... 2024-09-19T08:59:52.881 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fef6c0a32c0 msgr2=0x7fef6c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.881 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fef6c0a32c0 0x7fef6c0a5780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0058c0 tx=0x7fef7c00a250 comp rx=0 tx=0).stop 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 msgr2=0x7fef80100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80100bb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef78009dc0 tx=0x7fef78003ba0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 shutdown_connections 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fef6c0a32c0 0x7fef6c0a5780 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef80107920 0x7fef80100bb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef80104ff0 0x7fef80100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 --2- 172.21.15.184:0/3232925449 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef801026c0 0x7fef80102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.881+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 >> 172.21.15.184:0/3232925449 conn(0x7fef800fc280 msgr2=0x7fef80102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.882+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 shutdown_connections 2024-09-19T08:59:52.882 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-19T08:59:52.882+0000 7fef880c5640 1 -- 172.21.15.184:0/3232925449 wait complete. 2024-09-19T08:59:53.565 DEBUG:teuthology.orchestra.run.smithi083:mds.a> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T08:59:53.568 DEBUG:teuthology.orchestra.run.smithi083:mds.d> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T08:59:53.612 DEBUG:teuthology.orchestra.run.smithi083:mds.g> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T08:59:53.654 DEBUG:teuthology.orchestra.run.smithi083:mds.j> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T08:59:53.698 DEBUG:teuthology.orchestra.run.smithi122:mds.b> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T08:59:53.701 DEBUG:teuthology.orchestra.run.smithi122:mds.e> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T08:59:53.744 DEBUG:teuthology.orchestra.run.smithi122:mds.h> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T08:59:53.787 DEBUG:teuthology.orchestra.run.smithi122:mds.k> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T08:59:53.830 DEBUG:teuthology.orchestra.run.smithi184:mds.c> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T08:59:53.833 DEBUG:teuthology.orchestra.run.smithi184:mds.f> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T08:59:53.877 DEBUG:teuthology.orchestra.run.smithi184:mds.i> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T08:59:53.920 DEBUG:teuthology.orchestra.run.smithi184:mds.l> sudo journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T08:59:53.963 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T08:59:53.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:53.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:53.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:53.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:53.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:53.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:53 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-19T08:59:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:53 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:54.205 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-19T08:59:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:54.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:53 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:54.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 -- 172.21.15.83:0/3036686495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe810c170 msgr2=0x7fcbe810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/3036686495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe810c170 0x7fcbe810e610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009ca0 tx=0x7fcbe002a950 comp rx=0 tx=0).stop 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 -- 172.21.15.83:0/3036686495 shutdown_connections 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/3036686495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe810c170 0x7fcbe810e610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/3036686495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe8103660 0x7fcbe810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/3036686495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8102d40 0x7fcbe8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 -- 172.21.15.83:0/3036686495 >> 172.21.15.83:0/3036686495 conn(0x7fcbe80fc7a0 msgr2=0x7fcbe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 -- 172.21.15.83:0/3036686495 shutdown_connections 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.683+0000 7fcbee7dd640 1 -- 172.21.15.83:0/3036686495 wait complete. 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 Processor -- start 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 -- start start 2024-09-19T08:59:54.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111eb0 con 0x7fcbe8102d40 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111d30 con 0x7fcbe8103660 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbee7dd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8112030 con 0x7fcbe810c170 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46730/0 (socket says 172.21.15.83:46730) 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 -- 172.21.15.83:0/4136373963 learned_addr learned my addr 172.21.15.83:0/4136373963 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe77fe640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 -- 172.21.15.83:0/4136373963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe810c170 msgr2=0x7fcbe8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 -- 172.21.15.83:0/4136373963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8103660 msgr2=0x7fcbe8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.684+0000 7fcbe7fff640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbe7fff640 1 -- 172.21.15.83:0/4136373963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe81a6850 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbe77fe640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbe7fff640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800d950 tx=0x7fcbd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8017070 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbd8009c30 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe81a6b40 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800f620 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.685+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81a70d0 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.686+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe8103120 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.688+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcbd80109a0 con 0x7fcbe8102d40 2024-09-19T08:59:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.688+0000 7fcbe57fa640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcbd00a32c0 0x7fcbd00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.689+0000 7fcbe77fe640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcbd00a32c0 0x7fcbd00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.689+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcbd80cf090 con 0x7fcbe8102d40 2024-09-19T08:59:54.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.689+0000 7fcbe77fe640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcbd00a32c0 0x7fcbd00a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8102430 tx=0x7fcbdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.692+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbd8009de0 con 0x7fcbe8102d40 2024-09-19T08:59:54.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.892+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbe8101ed0 con 0x7fcbe8102d40 2024-09-19T08:59:54.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.892+0000 7fcbe57fa640 1 -- 172.21.15.83:0/4136373963 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fcbd809c2d0 con 0x7fcbe8102d40 2024-09-19T08:59:54.892 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:59:54.892 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":1,"btime":"2024-09-19T08:52:50:113112+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T08:59:54.893 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 1 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcbd00a32c0 msgr2=0x7fcbd00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcbd00a32c0 0x7fcbd00a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8102430 tx=0x7fcbdc008040 comp rx=0 tx=0).stop 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 msgr2=0x7fcbe81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800d950 tx=0x7fcbd800de10 comp rx=0 tx=0).stop 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 shutdown_connections 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcbd00a32c0 0x7fcbd00a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 --2- 172.21.15.83:0/4136373963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 >> 172.21.15.83:0/4136373963 conn(0x7fcbe80fc7a0 msgr2=0x7fcbe80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 shutdown_connections 2024-09-19T08:59:54.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:54.894+0000 7fcbee7dd640 1 -- 172.21.15.83:0/4136373963 wait complete. 2024-09-19T08:59:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:54 smithi184 ceph-mon[35007]: Deploying daemon mds.l on smithi184 2024-09-19T08:59:55.209 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:54 smithi083 ceph-mon[30926]: Deploying daemon mds.l on smithi184 2024-09-19T08:59:55.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:54 smithi122 ceph-mon[34247]: Deploying daemon mds.l on smithi184 2024-09-19T08:59:55.577 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 systemd[1]: Starting Ceph mds.l for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T08:59:55.833 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 podman[65306]: 2024-09-19 08:59:55.480537446 +0000 UTC m=+0.015725490 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:59:55.834 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 podman[65306]: 2024-09-19 08:59:55.598130156 +0000 UTC m=+0.133318183 container create 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T08:59:55.834 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 podman[65306]: 2024-09-19 08:59:55.834577995 +0000 UTC m=+0.369766039 container init 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T08:59:55.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:55 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4136373963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:55.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:55 smithi083 ceph-mon[30926]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:55.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:55 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6832/2584272411,v1:172.21.15.184:6833/2584272411] up:boot 2024-09-19T08:59:55.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:55 smithi083 ceph-mon[30926]: fsmap 1 up:standby 2024-09-19T08:59:55.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:55 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:59:56.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4136373963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:56.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-mon[35007]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:56.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6832/2584272411,v1:172.21.15.184:6833/2584272411] up:boot 2024-09-19T08:59:56.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-mon[35007]: fsmap 1 up:standby 2024-09-19T08:59:56.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:59:56.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 podman[65306]: 2024-09-19 08:59:55.837474424 +0000 UTC m=+0.372662450 container start 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T08:59:56.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-mds[65326]: -- 172.21.15.184:0/1555502157 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556fbd6a5860 con 0x556fbd683000 2024-09-19T08:59:56.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l[65322]: starting mds.l at 2024-09-19T08:59:56.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 bash[65306]: 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 2024-09-19T08:59:56.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 08:59:55 smithi184 systemd[1]: Started Ceph mds.l for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:59:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:55 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4136373963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:55 smithi122 ceph-mon[34247]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:55 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6832/2584272411,v1:172.21.15.184:6833/2584272411] up:boot 2024-09-19T08:59:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:55 smithi122 ceph-mon[34247]: fsmap 1 up:standby 2024-09-19T08:59:56.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:55 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:59:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:56 smithi122 ceph-mon[34247]: Deploying daemon mds.k on smithi122 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:57.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:57.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:57.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:56 smithi083 ceph-mon[30926]: Deploying daemon mds.k on smithi122 2024-09-19T08:59:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:57.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:57.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:57.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:56 smithi184 ceph-mon[35007]: Deploying daemon mds.k on smithi122 2024-09-19T08:59:57.686 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:59:57.941 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:58.062 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:57 smithi083 ceph-mon[30926]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:58.146 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:57 smithi122 ceph-mon[34247]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:57 smithi184 ceph-mon[35007]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 -- 172.21.15.83:0/3790977086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100a80 msgr2=0x7f841c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 --2- 172.21.15.83:0/3790977086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100a80 0x7f841c100ee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8410009cd0 tx=0x7f841002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 -- 172.21.15.83:0/3790977086 shutdown_connections 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 --2- 172.21.15.83:0/3790977086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c101420 0x7f841c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 --2- 172.21.15.83:0/3790977086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100a80 0x7f841c100ee0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 --2- 172.21.15.83:0/3790977086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c106a80 0x7f841c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 -- 172.21.15.83:0/3790977086 >> 172.21.15.83:0/3790977086 conn(0x7f841c0fc7a0 msgr2=0x7f841c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 -- 172.21.15.83:0/3790977086 shutdown_connections 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.469+0000 7f84209af640 1 -- 172.21.15.83:0/3790977086 wait complete. 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 Processor -- start 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 -- start start 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100a80 0x7f841c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 0x7f841c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c106a80 0x7f841c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f841c110d50 con 0x7f841c101420 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f841c110bd0 con 0x7f841c106a80 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f84209af640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f841c110ed0 con 0x7f841c100a80 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 0x7f841c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:58.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 0x7f841c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46742/0 (socket says 172.21.15.83:46742) 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 -- 172.21.15.83:0/3078963968 learned_addr learned my addr 172.21.15.83:0/3078963968 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f841ad9d640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c106a80 0x7f841c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f841a59c640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100a80 0x7f841c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 -- 172.21.15.83:0/3078963968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100a80 msgr2=0x7f841c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100a80 0x7f841c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 -- 172.21.15.83:0/3078963968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c106a80 msgr2=0x7f841c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c106a80 0x7f841c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 -- 172.21.15.83:0/3078963968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c19f570 con 0x7f841c101420 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.470+0000 7f8419d9b640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 0x7f841c19ab00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f841002ae00 tx=0x7f8410003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:58.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.471+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410004240 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.471+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c19f800 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.471+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84100305a0 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.471+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841003b640 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.471+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c1a7140 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.472+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c100ee0 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.473+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8410030ac0 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.473+0000 7f840b7fe640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a3240 0x7f84040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.473+0000 7f841a59c640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a3240 0x7f84040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.473+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f841002e030 con 0x7f841c101420 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.474+0000 7f841a59c640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a3240 0x7f84040a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8414005fd0 tx=0x7f8414005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:58.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.477+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84100bd810 con 0x7f841c101420 2024-09-19T08:59:58.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.680+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f841c1a7310 con 0x7f841c101420 2024-09-19T08:59:58.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.681+0000 7f840b7fe640 1 -- 172.21.15.83:0/3078963968 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f84100bd110 con 0x7f841c101420 2024-09-19T08:59:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T08:59:58.681 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":2,"btime":"2024-09-19T08:59:55:866216+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:59:58.681 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 2 2024-09-19T08:59:58.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a3240 msgr2=0x7f84040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a3240 0x7f84040a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8414005fd0 tx=0x7f8414005850 comp rx=0 tx=0).stop 2024-09-19T08:59:58.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 msgr2=0x7f841c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 0x7f841c19ab00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f841002ae00 tx=0x7f8410003ba0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 shutdown_connections 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a3240 0x7f84040a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c106a80 0x7f841c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c101420 0x7f841c19ab00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 --2- 172.21.15.83:0/3078963968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100a80 0x7f841c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 >> 172.21.15.83:0/3078963968 conn(0x7f841c0fc7a0 msgr2=0x7f841c10c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 shutdown_connections 2024-09-19T08:59:58.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T08:59:58.683+0000 7f84209af640 1 -- 172.21.15.83:0/3078963968 wait complete. 2024-09-19T08:59:58.960 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 08:59:58 smithi122 systemd[1]: Started Ceph mds.k for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3078963968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:58 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3078963968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:58 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3078963968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:58 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:00.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:59 smithi083 ceph-mon[30926]: Deploying daemon mds.j on smithi083 2024-09-19T09:00:00.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:59 smithi083 ceph-mon[30926]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:00.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:59 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6832/3460261556,v1:172.21.15.122:6833/3460261556] up:boot 2024-09-19T09:00:00.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:59 smithi083 ceph-mon[30926]: fsmap 2 up:standby 2024-09-19T09:00:00.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 08:59:59 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:00:00.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:59 smithi122 ceph-mon[34247]: Deploying daemon mds.j on smithi083 2024-09-19T09:00:00.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:59 smithi122 ceph-mon[34247]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:00.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:59 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6832/3460261556,v1:172.21.15.122:6833/3460261556] up:boot 2024-09-19T09:00:00.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:59 smithi122 ceph-mon[34247]: fsmap 2 up:standby 2024-09-19T09:00:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 08:59:59 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:00:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:59 smithi184 ceph-mon[35007]: Deploying daemon mds.j on smithi083 2024-09-19T09:00:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:59 smithi184 ceph-mon[35007]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:59 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6832/3460261556,v1:172.21.15.122:6833/3460261556] up:boot 2024-09-19T09:00:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:59 smithi184 ceph-mon[35007]: fsmap 2 up:standby 2024-09-19T09:00:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 08:59:59 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:00:01.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:00 smithi122 ceph-mon[34247]: overall HEALTH_OK 2024-09-19T09:00:01.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:00 smithi083 ceph-mon[30926]: overall HEALTH_OK 2024-09-19T09:00:01.350 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 systemd[1]: Starting Ceph mds.j for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:01.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:00 smithi184 ceph-mon[35007]: overall HEALTH_OK 2024-09-19T09:00:01.512 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:01.622 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 podman[68131]: 2024-09-19 09:00:01.252674094 +0000 UTC m=+0.015361962 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:01.622 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 podman[68131]: 2024-09-19 09:00:01.36959764 +0000 UTC m=+0.132285490 container create 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:00:01.622 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 podman[68131]: 2024-09-19 09:00:01.622905345 +0000 UTC m=+0.385593206 container init 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:00:01.803 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:01.925 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 podman[68131]: 2024-09-19 09:00:01.627672037 +0000 UTC m=+0.390359888 container start 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T09:00:01.925 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mds[68168]: -- 172.21.15.83:0/3123076873 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d135a9860 con 0x564d13587000 2024-09-19T09:00:01.925 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j[68146]: starting mds.j at 2024-09-19T09:00:01.925 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 bash[68131]: 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d 2024-09-19T09:00:01.925 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:00:01 smithi083 systemd[1]: Started Ceph mds.j for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:01 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:02.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 -- 172.21.15.83:0/1540629305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 msgr2=0x7f278c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 --2- 172.21.15.83:0/1540629305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c103110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f277c009cd0 tx=0x7f277c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 -- 172.21.15.83:0/1540629305 shutdown_connections 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 --2- 172.21.15.83:0/1540629305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 0x7f278c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 --2- 172.21.15.83:0/1540629305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 0x7f278c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 --2- 172.21.15.83:0/1540629305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c103110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 -- 172.21.15.83:0/1540629305 >> 172.21.15.83:0/1540629305 conn(0x7f278c0fc7d0 msgr2=0x7f278c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 -- 172.21.15.83:0/1540629305 shutdown_connections 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 -- 172.21.15.83:0/1540629305 wait complete. 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 Processor -- start 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 -- start start 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.317+0000 7f2793155640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 0x7f278c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2793155640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 0x7f278c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2793155640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f278c111fb0 con 0x7f278c102d30 2024-09-19T09:00:02.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2793155640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f278c111e30 con 0x7f278c1082a0 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2793155640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f278c112130 con 0x7f278c1036e0 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54810/0 (socket says 172.21.15.83:54810) 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 -- 172.21.15.83:0/3230839422 learned_addr learned my addr 172.21.15.83:0/3230839422 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f278bfff640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 0x7f278c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f27916f2640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 0x7f278c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 -- 172.21.15.83:0/3230839422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 msgr2=0x7f278c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 0x7f278c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 -- 172.21.15.83:0/3230839422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 msgr2=0x7f278c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 0x7f278c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 -- 172.21.15.83:0/3230839422 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c19d4e0 con 0x7f278c102d30 2024-09-19T09:00:02.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f278bfff640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 0x7f278c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f27916f2640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 0x7f278c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2790ef1640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c198530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f277c006010 tx=0x7f277c003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c004450 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f277c0045f0 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c19d770 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0466e0 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.318+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c1a50b0 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.320+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c103110 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.320+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f277c046880 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.321+0000 7f2789ffb640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27780a3240 0x7f27780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.321+0000 7f278bfff640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27780a3240 0x7f27780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.321+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f277c02e030 con 0x7f278c102d30 2024-09-19T09:00:02.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.322+0000 7f278bfff640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27780a3240 0x7f27780a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f278c0feea0 tx=0x7f2774005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.325+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f277c04b060 con 0x7f278c102d30 2024-09-19T09:00:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:02.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:02.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:01 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:01 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:02.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.537+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f278c10a2b0 con 0x7f278c102d30 2024-09-19T09:00:02.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.537+0000 7f2789ffb640 1 -- 172.21.15.83:0/3230839422 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f277c0be080 con 0x7f278c102d30 2024-09-19T09:00:02.538 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:02.538 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":4,"btime":"2024-09-19T09:00:01:977028+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:00:02.538 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 4 2024-09-19T09:00:02.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.539+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27780a3240 msgr2=0x7f27780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.539+0000 7f2793155640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27780a3240 0x7f27780a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f278c0feea0 tx=0x7f2774005d30 comp rx=0 tx=0).stop 2024-09-19T09:00:02.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.539+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 msgr2=0x7f278c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.539+0000 7f2793155640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c198530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f277c006010 tx=0x7f277c003c70 comp rx=0 tx=0).stop 2024-09-19T09:00:02.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 shutdown_connections 2024-09-19T09:00:02.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27780a3240 0x7f27780a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f278c1082a0 0x7f278c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c1036e0 0x7f278c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 --2- 172.21.15.83:0/3230839422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f278c102d30 0x7f278c198530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 >> 172.21.15.83:0/3230839422 conn(0x7f278c0fc7d0 msgr2=0x7f278c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 shutdown_connections 2024-09-19T09:00:02.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:02.540+0000 7f2793155640 1 -- 172.21.15.83:0/3230839422 wait complete. 2024-09-19T09:00:03.371 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:02 smithi083 ceph-mon[30926]: Deploying daemon mds.d on smithi083 2024-09-19T09:00:03.371 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:02 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6834/3427826085,v1:172.21.15.83:6835/3427826085] up:boot 2024-09-19T09:00:03.371 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:02 smithi083 ceph-mon[30926]: fsmap 3 up:standby 2024-09-19T09:00:03.371 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:02 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:00:03.371 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:02 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3230839422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:02 smithi184 ceph-mon[35007]: Deploying daemon mds.d on smithi083 2024-09-19T09:00:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:02 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6834/3427826085,v1:172.21.15.83:6835/3427826085] up:boot 2024-09-19T09:00:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:02 smithi184 ceph-mon[35007]: fsmap 3 up:standby 2024-09-19T09:00:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:02 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:00:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:02 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3230839422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:02 smithi122 ceph-mon[34247]: Deploying daemon mds.d on smithi083 2024-09-19T09:00:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:02 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6834/3427826085,v1:172.21.15.83:6835/3427826085] up:boot 2024-09-19T09:00:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:02 smithi122 ceph-mon[34247]: fsmap 3 up:standby 2024-09-19T09:00:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:02 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:00:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:02 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3230839422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:04.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:03 smithi184 ceph-mon[35007]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:04.371 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:03 smithi083 ceph-mon[30926]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:04.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:03 smithi122 ceph-mon[34247]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:05.181 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:04 smithi083 systemd[1]: Starting Ceph mds.d for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:05.430 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:05.449 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 podman[68548]: 2024-09-19 09:00:05.08491926 +0000 UTC m=+0.015907169 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:05.449 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 podman[68548]: 2024-09-19 09:00:05.187053486 +0000 UTC m=+0.118041432 container create 590bfce4f875e9efb0ef4e97b1253a4ad27aee092c4a3c90f8a4a1088af2cad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:00:05.449 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 podman[68548]: 2024-09-19 09:00:05.423186273 +0000 UTC m=+0.354174161 container init 590bfce4f875e9efb0ef4e97b1253a4ad27aee092c4a3c90f8a4a1088af2cad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:00:05.449 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 podman[68548]: 2024-09-19 09:00:05.425888719 +0000 UTC m=+0.356876595 container start 590bfce4f875e9efb0ef4e97b1253a4ad27aee092c4a3c90f8a4a1088af2cad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:00:05.449 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 ceph-mds[68568]: -- 172.21.15.83:0/1298698607 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56525f49f860 con 0x56525f47d000 2024-09-19T09:00:05.685 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:05.711 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d[68564]: starting mds.d at 2024-09-19T09:00:05.711 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 bash[68548]: 590bfce4f875e9efb0ef4e97b1253a4ad27aee092c4a3c90f8a4a1088af2cad2 2024-09-19T09:00:05.711 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:00:05 smithi083 systemd[1]: Started Ceph mds.d for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:06.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:06.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.102 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.103 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:06.103 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:06.103 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:06 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:06.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 -- 172.21.15.83:0/22134454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 msgr2=0x7fc21c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 --2- 172.21.15.83:0/22134454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c10da40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc214009ca0 tx=0x7fc21402a950 comp rx=0 tx=0).stop 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 -- 172.21.15.83:0/22134454 shutdown_connections 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 --2- 172.21.15.83:0/22134454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c10da40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 --2- 172.21.15.83:0/22134454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc21c102570 0x7fc21c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 --2- 172.21.15.83:0/22134454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c100e20 0x7fc21c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 -- 172.21.15.83:0/22134454 >> 172.21.15.83:0/22134454 conn(0x7fc21c0fc7d0 msgr2=0x7fc21c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 -- 172.21.15.83:0/22134454 shutdown_connections 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.183+0000 7fc221916640 1 -- 172.21.15.83:0/22134454 wait complete. 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 Processor -- start 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 -- start start 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc21c100e20 0x7fc21c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c102570 0x7fc21c1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c110e50 con 0x7fc21c102ef0 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c110cd0 con 0x7fc21c102570 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc221916640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c110fd0 con 0x7fc21c100e20 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c19bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54828/0 (socket says 172.21.15.83:54828) 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21b7fe640 1 -- 172.21.15.83:0/1578551874 learned_addr learned my addr 172.21.15.83:0/1578551874 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21affd640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc21c100e20 0x7fc21c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc2127fc640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c102570 0x7fc21c1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21b7fe640 1 -- 172.21.15.83:0/1578551874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc21c100e20 msgr2=0x7fc21c1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21b7fe640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc21c100e20 0x7fc21c1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.184+0000 7fc21b7fe640 1 -- 172.21.15.83:0/1578551874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c102570 msgr2=0x7fc21c1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc21b7fe640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c102570 0x7fc21c1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc21b7fe640 1 -- 172.21.15.83:0/1578551874 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c19c360 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc21b7fe640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c19bc80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc21402ae70 tx=0x7fc21402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214034040 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2140308f0 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c19c5f0 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214004780 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.185+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c1a3f30 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.186+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c101200 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.188+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc214037020 con 0x7fc21c102ef0 2024-09-19T09:00:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.189+0000 7fc220914640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2080a32c0 0x7fc2080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.189+0000 7fc21affd640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2080a32c0 0x7fc2080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.189+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc2140f05b0 con 0x7fc21c102ef0 2024-09-19T09:00:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.189+0000 7fc21affd640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2080a32c0 0x7fc2080a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc20c005fd0 tx=0x7fc20c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.192+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2140bd770 con 0x7fc21c102ef0 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:06.361 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:06 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.393+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc21c109090 con 0x7fc21c102ef0 2024-09-19T09:00:06.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.394+0000 7fc220914640 1 -- 172.21.15.83:0/1578551874 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fc2140bd070 con 0x7fc21c102ef0 2024-09-19T09:00:06.394 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:06.394 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"btime":"2024-09-19T09:00:05:995360+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:00:06.394 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 5 2024-09-19T09:00:06.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.396+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2080a32c0 msgr2=0x7fc2080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.396+0000 7fc221916640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2080a32c0 0x7fc2080a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc20c005fd0 tx=0x7fc20c00b590 comp rx=0 tx=0).stop 2024-09-19T09:00:06.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.396+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 msgr2=0x7fc21c19bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.396+0000 7fc221916640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c19bc80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc21402ae70 tx=0x7fc21402f5d0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 shutdown_connections 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2080a32c0 0x7fc2080a5780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc21c102ef0 0x7fc21c19bc80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc21c102570 0x7fc21c1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 --2- 172.21.15.83:0/1578551874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc21c100e20 0x7fc21c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 >> 172.21.15.83:0/1578551874 conn(0x7fc21c0fc7d0 msgr2=0x7fc21c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 shutdown_connections 2024-09-19T09:00:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:06.397+0000 7fc221916640 1 -- 172.21.15.83:0/1578551874 wait complete. 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:06 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:07.308 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:07 smithi122 ceph-mon[34247]: Deploying daemon mds.e on smithi122 2024-09-19T09:00:07.308 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:07 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6836/1285159931,v1:172.21.15.83:6837/1285159931] up:boot 2024-09-19T09:00:07.308 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:07 smithi122 ceph-mon[34247]: fsmap 4 up:standby 2024-09-19T09:00:07.308 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:07 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:00:07.308 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1578551874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:07 smithi184 ceph-mon[35007]: Deploying daemon mds.e on smithi122 2024-09-19T09:00:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:07 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6836/1285159931,v1:172.21.15.83:6837/1285159931] up:boot 2024-09-19T09:00:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:07 smithi184 ceph-mon[35007]: fsmap 4 up:standby 2024-09-19T09:00:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:07 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:00:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1578551874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:07 smithi083 ceph-mon[30926]: Deploying daemon mds.e on smithi122 2024-09-19T09:00:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:07 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6836/1285159931,v1:172.21.15.83:6837/1285159931] up:boot 2024-09-19T09:00:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:07 smithi083 ceph-mon[30926]: fsmap 4 up:standby 2024-09-19T09:00:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:07 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:00:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:07 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1578551874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:07.961 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:07 smithi122 podman[62918]: 2024-09-19 09:00:07.928371022 +0000 UTC m=+0.129560480 container create 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:00:08.289 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:08 smithi122 ceph-mon[34247]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:08.290 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:08 smithi122 podman[62918]: 2024-09-19 09:00:08.19827519 +0000 UTC m=+0.399464608 container init 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:00:08.290 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:08 smithi122 podman[62918]: 2024-09-19 09:00:08.201143109 +0000 UTC m=+0.402332515 container start 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:00:08.290 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:08 smithi122 ceph-mds[62938]: -- 172.21.15.122:0/2474094949 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e102e59860 con 0x55e102e36800 2024-09-19T09:00:08.290 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:08 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e[62934]: starting mds.e at 2024-09-19T09:00:08.290 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:08 smithi122 bash[62918]: 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 2024-09-19T09:00:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:08 smithi184 ceph-mon[35007]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:08.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:08 smithi083 ceph-mon[30926]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:08.710 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:00:08 smithi122 systemd[1]: Started Ceph mds.e for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:09.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:09.347 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:09.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: Deploying daemon mds.f on smithi184 2024-09-19T09:00:09.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:09.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6834/2324915489,v1:172.21.15.122:6835/2324915489] up:boot 2024-09-19T09:00:09.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: fsmap 5 up:standby 2024-09-19T09:00:09.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:09 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: Deploying daemon mds.f on smithi184 2024-09-19T09:00:09.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:09.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6834/2324915489,v1:172.21.15.122:6835/2324915489] up:boot 2024-09-19T09:00:09.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: fsmap 5 up:standby 2024-09-19T09:00:09.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:09 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:00:09.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:09.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: Deploying daemon mds.f on smithi184 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6834/2324915489,v1:172.21.15.122:6835/2324915489] up:boot 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: fsmap 5 up:standby 2024-09-19T09:00:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:09 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 -- 172.21.15.83:0/3609159499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340106f10 msgr2=0x7fd34010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 --2- 172.21.15.83:0/3609159499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340106f10 0x7fd34010ea90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd338009ca0 tx=0x7fd33802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 -- 172.21.15.83:0/3609159499 shutdown_connections 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 --2- 172.21.15.83:0/3609159499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340106f10 0x7fd34010ea90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 --2- 172.21.15.83:0/3609159499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340102790 0x7fd3401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 --2- 172.21.15.83:0/3609159499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd340101de0 0x7fd3401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 -- 172.21.15.83:0/3609159499 >> 172.21.15.83:0/3609159499 conn(0x7fd3400fd8c0 msgr2=0x7fd3400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 -- 172.21.15.83:0/3609159499 shutdown_connections 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 -- 172.21.15.83:0/3609159499 wait complete. 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 Processor -- start 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.865+0000 7fd347217640 1 -- start start 2024-09-19T09:00:09.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 0x7fd340198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd340102790 0x7fd340198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340106f10 0x7fd34019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd340111e20 con 0x7fd340101de0 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd340111ca0 con 0x7fd340102790 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd340111fa0 con 0x7fd340106f10 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 0x7fd340198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 0x7fd340198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54840/0 (socket says 172.21.15.83:54840) 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 -- 172.21.15.83:0/2284529639 learned_addr learned my addr 172.21.15.83:0/2284529639 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd3457b4640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340106f10 0x7fd34019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd33ffff640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd340102790 0x7fd340198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 -- 172.21.15.83:0/2284529639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340106f10 msgr2=0x7fd34019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340106f10 0x7fd34019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 -- 172.21.15.83:0/2284529639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd340102790 msgr2=0x7fd340198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd340102790 0x7fd340198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 -- 172.21.15.83:0/2284529639 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34019d2f0 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd3457b4640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340106f10 0x7fd34019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd344fb3640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 0x7fd340198340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd33400d950 tx=0x7fd33400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334017070 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34019d5e0 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd334009c30 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.866+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33400f620 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.867+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401a4ec0 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.868+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3401021c0 con 0x7fd340101de0 2024-09-19T09:00:09.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.868+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd3340109a0 con 0x7fd340101de0 2024-09-19T09:00:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.869+0000 7fd33dffb640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd3300a3240 0x7fd3300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.869+0000 7fd33ffff640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd3300a3240 0x7fd3300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.869+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd3340cf1f0 con 0x7fd340101de0 2024-09-19T09:00:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.870+0000 7fd33ffff640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd3300a3240 0x7fd3300a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd32c005fd0 tx=0x7fd32c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:09.873+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd334009de0 con 0x7fd340101de0 2024-09-19T09:00:10.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.072+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd34010a0f0 con 0x7fd340101de0 2024-09-19T09:00:10.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.073+0000 7fd33dffb640 1 -- 172.21.15.83:0/2284529639 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7fd33409c310 con 0x7fd340101de0 2024-09-19T09:00:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:10.074 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"btime":"2024-09-19T09:00:09:027184+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:00:10.074 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd3300a3240 msgr2=0x7fd3300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd3300a3240 0x7fd3300a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd32c005fd0 tx=0x7fd32c005850 comp rx=0 tx=0).stop 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 msgr2=0x7fd340198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 0x7fd340198340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd33400d950 tx=0x7fd33400de10 comp rx=0 tx=0).stop 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 shutdown_connections 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd3300a3240 0x7fd3300a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd340106f10 0x7fd34019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd340102790 0x7fd340198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 --2- 172.21.15.83:0/2284529639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd340101de0 0x7fd340198340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 >> 172.21.15.83:0/2284529639 conn(0x7fd3400fd8c0 msgr2=0x7fd3400fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:10.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 shutdown_connections 2024-09-19T09:00:10.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:10.076+0000 7fd347217640 1 -- 172.21.15.83:0/2284529639 wait complete. 2024-09-19T09:00:10.354 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 systemd[1]: Starting Ceph mds.f for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:10.620 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:10 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2284529639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:10.620 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 podman[65614]: 2024-09-19 09:00:10.386305844 +0000 UTC m=+0.016034114 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:10.620 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 podman[65614]: 2024-09-19 09:00:10.48694341 +0000 UTC m=+0.116671713 container create 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:00:10.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:10 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2284529639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:10.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:10 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2284529639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:11.149 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 podman[65614]: 2024-09-19 09:00:10.740202604 +0000 UTC m=+0.369930868 container init 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T09:00:11.149 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 podman[65614]: 2024-09-19 09:00:10.743195056 +0000 UTC m=+0.372923317 container start 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:00:11.149 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 ceph-mds[65633]: -- 172.21.15.184:0/3845598695 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1102b5860 con 0x55a110293400 2024-09-19T09:00:11.149 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f[65629]: starting mds.f at 2024-09-19T09:00:11.149 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 bash[65614]: 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f 2024-09-19T09:00:11.149 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:00:10 smithi184 systemd[1]: Started Ceph mds.f for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: Deploying daemon mds.c on smithi184 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6834/1361922279,v1:172.21.15.184:6835/1361922279] up:boot 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: fsmap 6 up:standby 2024-09-19T09:00:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:11 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:00:12.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: Deploying daemon mds.c on smithi184 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6834/1361922279,v1:172.21.15.184:6835/1361922279] up:boot 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: fsmap 6 up:standby 2024-09-19T09:00:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:11 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: Deploying daemon mds.c on smithi184 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6834/1361922279,v1:172.21.15.184:6835/1361922279] up:boot 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: fsmap 6 up:standby 2024-09-19T09:00:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:11 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:00:12.804 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:13.044 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:12 smithi184 systemd[1]: Starting Ceph mds.c for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:13.060 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:13.330 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 podman[65911]: 2024-09-19 09:00:12.946833823 +0000 UTC m=+0.016029388 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:13.331 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 podman[65911]: 2024-09-19 09:00:13.062080167 +0000 UTC m=+0.131275732 container create 92a1dc137dce9e10714c86f442b250c119cf2783d71f09706aaff14c0987dc04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:00:13.331 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 podman[65911]: 2024-09-19 09:00:13.331689945 +0000 UTC m=+0.400885514 container init 92a1dc137dce9e10714c86f442b250c119cf2783d71f09706aaff14c0987dc04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:00:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 -- 172.21.15.83:0/4060939925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 msgr2=0x7efdb810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 --2- 172.21.15.83:0/4060939925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb810d950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009cd0 tx=0x7efdb002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 -- 172.21.15.83:0/4060939925 shutdown_connections 2024-09-19T09:00:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 --2- 172.21.15.83:0/4060939925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb810d950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 --2- 172.21.15.83:0/4060939925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8100a80 0x7efdb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 --2- 172.21.15.83:0/4060939925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb8106a80 0x7efdb8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 -- 172.21.15.83:0/4060939925 >> 172.21.15.83:0/4060939925 conn(0x7efdb80fc7a0 msgr2=0x7efdb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.573+0000 7efdbefa9640 1 -- 172.21.15.83:0/4060939925 shutdown_connections 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 -- 172.21.15.83:0/4060939925 wait complete. 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 Processor -- start 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 -- start start 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb8100a80 0x7efdb8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8106a80 0x7efdb819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8110d30 con 0x7efdb8101420 2024-09-19T09:00:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8110bb0 con 0x7efdb8100a80 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbefa9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8110eb0 con 0x7efdb8106a80 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb8198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35682/0 (socket says 172.21.15.83:35682) 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdb7fff640 1 -- 172.21.15.83:0/857826290 learned_addr learned my addr 172.21.15.83:0/857826290 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.574+0000 7efdbcd45640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb8100a80 0x7efdb8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdbd546640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8106a80 0x7efdb819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb7fff640 1 -- 172.21.15.83:0/857826290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8106a80 msgr2=0x7efdb819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb7fff640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8106a80 0x7efdb819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb7fff640 1 -- 172.21.15.83:0/857826290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb8100a80 msgr2=0x7efdb8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb7fff640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb8100a80 0x7efdb8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb7fff640 1 -- 172.21.15.83:0/857826290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb819d2d0 con 0x7efdb8101420 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdbd546640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8106a80 0x7efdb819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb7fff640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb8198860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efdac00e9f0 tx=0x7efdac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac00cd80 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdac0054d0 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb819d5c0 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac010490 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.575+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb81a4ea0 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.576+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb8100ee0 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.577+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efdac005020 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.578+0000 7efdb5ffb640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7efda00a3240 0x7efda00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.578+0000 7efdbcd45640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7efda00a3240 0x7efda00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.578+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7efdac0cf880 con 0x7efdb8101420 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.578+0000 7efdbcd45640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7efda00a3240 0x7efda00a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efda800bb60 tx=0x7efda800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.582+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efdac09ca40 con 0x7efdb8101420 2024-09-19T09:00:13.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 podman[65911]: 2024-09-19 09:00:13.334557658 +0000 UTC m=+0.403753232 container start 92a1dc137dce9e10714c86f442b250c119cf2783d71f09706aaff14c0987dc04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:00:13.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mds[65930]: -- 172.21.15.184:0/2457655281 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aeccbf3860 con 0x55aeccbd1400 2024-09-19T09:00:13.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c[65926]: starting mds.c at 2024-09-19T09:00:13.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 bash[65911]: 92a1dc137dce9e10714c86f442b250c119cf2783d71f09706aaff14c0987dc04 2024-09-19T09:00:13.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:00:13 smithi184 systemd[1]: Started Ceph mds.c for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.781+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdb81a5100 con 0x7efdb8101420 2024-09-19T09:00:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.782+0000 7efdb5ffb640 1 -- 172.21.15.83:0/857826290 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7efdac09c340 con 0x7efdb8101420 2024-09-19T09:00:13.783 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:13.783 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":7,"btime":"2024-09-19T09:00:11:354040+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T09:00:13.783 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 7 2024-09-19T09:00:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7efda00a3240 msgr2=0x7efda00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7efda00a3240 0x7efda00a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efda800bb60 tx=0x7efda800b390 comp rx=0 tx=0).stop 2024-09-19T09:00:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 msgr2=0x7efdb8198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb8198860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efdac00e9f0 tx=0x7efdac00edf0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 shutdown_connections 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7efda00a3240 0x7efda00a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdb8106a80 0x7efdb819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb8101420 0x7efdb8198860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 --2- 172.21.15.83:0/857826290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb8100a80 0x7efdb8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 >> 172.21.15.83:0/857826290 conn(0x7efdb80fc7a0 msgr2=0x7efdb8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 shutdown_connections 2024-09-19T09:00:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:13.784+0000 7efdbefa9640 1 -- 172.21.15.83:0/857826290 wait complete. 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:14.077 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:14.078 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:13 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/857826290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:14.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:13 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/857826290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:13 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/857826290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:14 smithi184 ceph-mon[35007]: Deploying daemon mds.h on smithi122 2024-09-19T09:00:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:14 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] up:boot 2024-09-19T09:00:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:14 smithi184 ceph-mon[35007]: fsmap 7 up:standby 2024-09-19T09:00:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:14 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:00:15.401 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:14 smithi122 ceph-mon[34247]: Deploying daemon mds.h on smithi122 2024-09-19T09:00:15.401 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:14 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] up:boot 2024-09-19T09:00:15.401 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:14 smithi122 ceph-mon[34247]: fsmap 7 up:standby 2024-09-19T09:00:15.401 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:14 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:00:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:14 smithi083 ceph-mon[30926]: Deploying daemon mds.h on smithi122 2024-09-19T09:00:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:14 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] up:boot 2024-09-19T09:00:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:14 smithi083 ceph-mon[30926]: fsmap 7 up:standby 2024-09-19T09:00:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:14 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:00:15.710 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:15 smithi122 systemd[1]: Starting Ceph mds.h for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:16.074 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:15 smithi122 ceph-mon[34247]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:16.075 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:15 smithi122 podman[63223]: 2024-09-19 09:00:15.705155841 +0000 UTC m=+0.015864545 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:16.075 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:15 smithi122 podman[63223]: 2024-09-19 09:00:15.829233697 +0000 UTC m=+0.139942391 container create 55448c28fc2622613636d4e2646f9388fccbb9b0cbb7b2ad63635bebff059a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:00:16.075 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:16 smithi122 podman[63223]: 2024-09-19 09:00:16.049255166 +0000 UTC m=+0.359963864 container init 55448c28fc2622613636d4e2646f9388fccbb9b0cbb7b2ad63635bebff059a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:00:16.075 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:16 smithi122 podman[63223]: 2024-09-19 09:00:16.052353379 +0000 UTC m=+0.363062073 container start 55448c28fc2622613636d4e2646f9388fccbb9b0cbb7b2ad63635bebff059a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:00:16.075 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:16 smithi122 ceph-mds[63242]: -- 172.21.15.122:0/985822904 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd12163860 con 0x55cd12141400 2024-09-19T09:00:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:15 smithi184 ceph-mon[35007]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:16.460 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:16 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h[63238]: starting mds.h at 2024-09-19T09:00:16.460 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:16 smithi122 bash[63223]: 55448c28fc2622613636d4e2646f9388fccbb9b0cbb7b2ad63635bebff059a50 2024-09-19T09:00:16.461 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:00:16 smithi122 systemd[1]: Started Ceph mds.h for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:15 smithi083 ceph-mon[30926]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:16.531 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:16.793 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:17.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 -- 172.21.15.83:0/816848039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 msgr2=0x7f8a2010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/816848039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a2010d950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009cd0 tx=0x7f8a1802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 -- 172.21.15.83:0/816848039 shutdown_connections 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/816848039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a2010d950 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/816848039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a20100a80 0x7f8a20100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/816848039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a20106a80 0x7f8a20106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 -- 172.21.15.83:0/816848039 >> 172.21.15.83:0/816848039 conn(0x7f8a200fc7a0 msgr2=0x7f8a200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 -- 172.21.15.83:0/816848039 shutdown_connections 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.269+0000 7f8a27f5a640 1 -- 172.21.15.83:0/816848039 wait complete. 2024-09-19T09:00:17.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 Processor -- start 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 -- start start 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a20100a80 0x7f8a201971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a201976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a20106a80 0x7f8a2019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20110d80 con 0x7f8a20101420 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20110c00 con 0x7f8a20106a80 2024-09-19T09:00:17.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a27f5a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20110f00 con 0x7f8a20100a80 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a254f5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a201976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a254f5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a201976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35696/0 (socket says 172.21.15.83:35696) 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.270+0000 7f8a254f5640 1 -- 172.21.15.83:0/3575209250 learned_addr learned my addr 172.21.15.83:0/3575209250 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a25cf6640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a20100a80 0x7f8a201971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a264f7640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a20106a80 0x7f8a2019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a254f5640 1 -- 172.21.15.83:0/3575209250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a20100a80 msgr2=0x7f8a201971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a254f5640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a20100a80 0x7f8a201971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a254f5640 1 -- 172.21.15.83:0/3575209250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a20106a80 msgr2=0x7f8a2019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a254f5640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a20106a80 0x7f8a2019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a254f5640 1 -- 172.21.15.83:0/3575209250 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2019c150 con 0x7f8a20101420 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a254f5640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a201976e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000c920 tx=0x7f8a1000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10007bb0 con 0x7f8a20101420 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a10007d50 con 0x7f8a20101420 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2019c440 con 0x7f8a20101420 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10018730 con 0x7f8a20101420 2024-09-19T09:00:17.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.271+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201a3d20 con 0x7f8a20101420 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.272+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20100ee0 con 0x7f8a20101420 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.274+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8a1000f450 con 0x7f8a20101420 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.275+0000 7f8a16ffd640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.275+0000 7f8a25cf6640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.275+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f8a100cf890 con 0x7f8a20101420 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.275+0000 7f8a25cf6640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00ab60 tx=0x7f8a1c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:17.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.278+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a10014030 con 0x7f8a20101420 2024-09-19T09:00:17.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.347 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: Deploying daemon mds.i on smithi184 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] up:boot 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: fsmap 8 up:standby 2024-09-19T09:00:17.348 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:17 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:00:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:17.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: Deploying daemon mds.i on smithi184 2024-09-19T09:00:17.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:17.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] up:boot 2024-09-19T09:00:17.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: fsmap 8 up:standby 2024-09-19T09:00:17.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:17 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:00:17.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.480+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a20198500 con 0x7f8a20101420 2024-09-19T09:00:17.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.480+0000 7f8a16ffd640 1 -- 172.21.15.83:0/3575209250 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f8a1000de20 con 0x7f8a20101420 2024-09-19T09:00:17.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:17.481 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-19T09:00:16:968788+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:00:17.481 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8a0c0a3240 msgr2=0x7f8a0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00ab60 tx=0x7f8a1c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 msgr2=0x7f8a201976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a201976e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000c920 tx=0x7f8a1000cd20 comp rx=0 tx=0).stop 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 shutdown_connections 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a20106a80 0x7f8a2019ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a20101420 0x7f8a201976e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 --2- 172.21.15.83:0/3575209250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a20100a80 0x7f8a201971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 >> 172.21.15.83:0/3575209250 conn(0x7f8a200fc7a0 msgr2=0x7f8a200fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:17.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 shutdown_connections 2024-09-19T09:00:17.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:17.483+0000 7f8a27f5a640 1 -- 172.21.15.83:0/3575209250 wait complete. 2024-09-19T09:00:17.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: Deploying daemon mds.i on smithi184 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] up:boot 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: fsmap 8 up:standby 2024-09-19T09:00:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:17 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:00:18.238 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 systemd[1]: Starting Ceph mds.i for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:18.587 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:18 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3575209250' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.588 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 podman[66211]: 2024-09-19 09:00:18.241938215 +0000 UTC m=+0.016883543 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:18.588 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 podman[66211]: 2024-09-19 09:00:18.351837922 +0000 UTC m=+0.126783235 container create 56af261455cf3421b63205575aee1251180a5ce059a24d13f9300c6178e35a5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:00:18.588 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 podman[66211]: 2024-09-19 09:00:18.588599761 +0000 UTC m=+0.363545077 container init 56af261455cf3421b63205575aee1251180a5ce059a24d13f9300c6178e35a5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:00:18.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:18 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3575209250' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:18 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3575209250' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.899 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 podman[66211]: 2024-09-19 09:00:18.591427655 +0000 UTC m=+0.366372968 container start 56af261455cf3421b63205575aee1251180a5ce059a24d13f9300c6178e35a5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:00:18.899 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 ceph-mds[66230]: -- 172.21.15.184:0/1121571857 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee42597860 con 0x55ee42574800 2024-09-19T09:00:18.899 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i[66226]: starting mds.i at 2024-09-19T09:00:18.899 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 bash[66211]: 56af261455cf3421b63205575aee1251180a5ce059a24d13f9300c6178e35a5c 2024-09-19T09:00:18.899 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:00:18 smithi184 systemd[1]: Started Ceph mds.i for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:20.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: Deploying daemon mds.g on smithi083 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] up:boot 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: fsmap 9 up:standby 2024-09-19T09:00:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:19 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:00:20.190 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: Deploying daemon mds.g on smithi083 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] up:boot 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: fsmap 9 up:standby 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:19 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: Deploying daemon mds.g on smithi083 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] up:boot 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: fsmap 9 up:standby 2024-09-19T09:00:20.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:19 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:00:20.465 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 -- 172.21.15.83:0/1929668374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec102d30 msgr2=0x7fb8ec103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/1929668374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec102d30 0x7fb8ec103110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009930 tx=0x7fb8e802a420 comp rx=0 tx=0).stop 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 -- 172.21.15.83:0/1929668374 shutdown_connections 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/1929668374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/1929668374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 0x7fb8ec107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/1929668374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec102d30 0x7fb8ec103110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 -- 172.21.15.83:0/1929668374 >> 172.21.15.83:0/1929668374 conn(0x7fb8ec0fc7d0 msgr2=0x7fb8ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 -- 172.21.15.83:0/1929668374 shutdown_connections 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 -- 172.21.15.83:0/1929668374 wait complete. 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 Processor -- start 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 -- start start 2024-09-19T09:00:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.983+0000 7fb8f3a36640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec102d30 0x7fb8ec198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 0x7fb8ec198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec111fb0 con 0x7fb8ec1082a0 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec111e30 con 0x7fb8ec1036e0 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec112130 con 0x7fb8ec102d30 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57678/0 (socket says 172.21.15.83:57678) 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 -- 172.21.15.83:0/2001892739 learned_addr learned my addr 172.21.15.83:0/2001892739 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f17d2640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec102d30 0x7fb8ec198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f0fd1640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 0x7fb8ec198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 -- 172.21.15.83:0/2001892739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec102d30 msgr2=0x7fb8ec198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec102d30 0x7fb8ec198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 -- 172.21.15.83:0/2001892739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 msgr2=0x7fb8ec198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 0x7fb8ec198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 -- 172.21.15.83:0/2001892739 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec19d500 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f0fd1640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 0x7fb8ec198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f17d2640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec102d30 0x7fb8ec198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f1fd3640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec19ce20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400b970 tx=0x7fb8e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4019070 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec19d7f0 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8e4014440 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40075d0 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.984+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec1a50d0 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.985+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec06a850 con 0x7fb8ec1082a0 2024-09-19T09:00:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.986+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb8e401c070 con 0x7fb8ec1082a0 2024-09-19T09:00:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.987+0000 7fb8e27fc640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb8d80a3240 0x7fb8d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.987+0000 7fb8f17d2640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb8d80a3240 0x7fb8d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.987+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb8e40cef40 con 0x7fb8ec1082a0 2024-09-19T09:00:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.988+0000 7fb8f17d2640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb8d80a3240 0x7fb8d80a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8000c00 tx=0x7fb8e8009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:20.990+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8e409c100 con 0x7fb8ec1082a0 2024-09-19T09:00:21.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.200+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8ec103110 con 0x7fb8ec1082a0 2024-09-19T09:00:21.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.201+0000 7fb8e27fc640 1 -- 172.21.15.83:0/2001892739 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7fb8ec103110 con 0x7fb8ec1082a0 2024-09-19T09:00:21.201 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:21.201 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":10,"btime":"2024-09-19T09:00:19:238556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:00:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 10 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb8d80a3240 msgr2=0x7fb8d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb8d80a3240 0x7fb8d80a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8000c00 tx=0x7fb8e8009610 comp rx=0 tx=0).stop 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 msgr2=0x7fb8ec19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec19ce20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400b970 tx=0x7fb8e400be30 comp rx=0 tx=0).stop 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 shutdown_connections 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb8d80a3240 0x7fb8d80a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8ec1082a0 0x7fb8ec19ce20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ec1036e0 0x7fb8ec198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 --2- 172.21.15.83:0/2001892739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec102d30 0x7fb8ec198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 >> 172.21.15.83:0/2001892739 conn(0x7fb8ec0fc7d0 msgr2=0x7fb8ec105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:21.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 shutdown_connections 2024-09-19T09:00:21.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:21.203+0000 7fb8f3a36640 1 -- 172.21.15.83:0/2001892739 wait complete. 2024-09-19T09:00:22.092 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:21 smithi083 ceph-mon[30926]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:22.093 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:21 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2001892739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:22.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:21 smithi184 ceph-mon[35007]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:22.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:21 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2001892739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:22.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:21 smithi122 ceph-mon[34247]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:22.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:21 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2001892739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:22.461 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:00:22 smithi083 systemd[1]: Started Ceph mds.g for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:23.284 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: Deploying daemon mds.a on smithi083 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6838/37046716,v1:172.21.15.83:6839/37046716] up:boot 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: fsmap 10 up:standby 2024-09-19T09:00:23.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:23 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:00:23.633 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.633 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.633 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: Deploying daemon mds.a on smithi083 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6838/37046716,v1:172.21.15.83:6839/37046716] up:boot 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: fsmap 10 up:standby 2024-09-19T09:00:23.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:23 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: Deploying daemon mds.a on smithi083 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6838/37046716,v1:172.21.15.83:6839/37046716] up:boot 2024-09-19T09:00:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: fsmap 10 up:standby 2024-09-19T09:00:23.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:23 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:00:23.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:24.381 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 systemd[1]: Starting Ceph mds.a for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:24.700 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 podman[69758]: 2024-09-19 09:00:24.283775839 +0000 UTC m=+0.015977795 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:24.700 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 podman[69758]: 2024-09-19 09:00:24.42496182 +0000 UTC m=+0.157163766 container create 0f6e657e40e61c9948d1d5766ceff36233b167d21213b07ccd4b598a8cff6e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:00:24.700 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 podman[69758]: 2024-09-19 09:00:24.70103722 +0000 UTC m=+0.433239163 container init 0f6e657e40e61c9948d1d5766ceff36233b167d21213b07ccd4b598a8cff6e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:00:24.917 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:24.961 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 podman[69758]: 2024-09-19 09:00:24.703784743 +0000 UTC m=+0.435986695 container start 0f6e657e40e61c9948d1d5766ceff36233b167d21213b07ccd4b598a8cff6e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:00:24.961 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 ceph-mds[69789]: -- 172.21.15.83:0/1047943703 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572fa345860 con 0x5572fa322800 2024-09-19T09:00:24.961 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a[69785]: starting mds.a at 2024-09-19T09:00:24.961 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 bash[69758]: 0f6e657e40e61c9948d1d5766ceff36233b167d21213b07ccd4b598a8cff6e75 2024-09-19T09:00:24.961 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:00:24 smithi083 systemd[1]: Started Ceph mds.a for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 -- 172.21.15.83:0/386771292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0106a80 msgr2=0x7f76c0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/386771292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0106a80 0x7f76c0106e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009930 tx=0x7f76bc02a420 comp rx=0 tx=0).stop 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 -- 172.21.15.83:0/386771292 shutdown_connections 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/386771292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c0101420 0x7f76c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/386771292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c0100a80 0x7f76c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/386771292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0106a80 0x7f76c0106e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 -- 172.21.15.83:0/386771292 >> 172.21.15.83:0/386771292 conn(0x7f76c00fc7a0 msgr2=0x7f76c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 -- 172.21.15.83:0/386771292 shutdown_connections 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.395+0000 7f76c7b6b640 1 -- 172.21.15.83:0/386771292 wait complete. 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 Processor -- start 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 -- start start 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c0100a80 0x7f76c01970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 0x7f76c0197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c0106a80 0x7f76c0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0110d50 con 0x7f76c0101420 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0110bd0 con 0x7f76c0100a80 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c7b6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0110ed0 con 0x7f76c0106a80 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5106640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 0x7f76c0197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5106640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 0x7f76c0197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57748/0 (socket says 172.21.15.83:57748) 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5106640 1 -- 172.21.15.83:0/276971207 learned_addr learned my addr 172.21.15.83:0/276971207 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5907640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c0100a80 0x7f76c01970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5106640 1 -- 172.21.15.83:0/276971207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c0106a80 msgr2=0x7f76c0197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5106640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c0106a80 0x7f76c0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.396+0000 7f76c5106640 1 -- 172.21.15.83:0/276971207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c0100a80 msgr2=0x7f76c01970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76c5106640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c0100a80 0x7f76c01970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76c5106640 1 -- 172.21.15.83:0/276971207 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c01a6940 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76c5106640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 0x7f76c0197610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b4a0 tx=0x7f76b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0014070 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76b0010ac0 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c01a6c30 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0017c30 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.397+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01a7170 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.398+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c0100ee0 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.399+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f76b0017070 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.400+0000 7f76b6ffd640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76ac0a3240 0x7f76ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.400+0000 7f76c5907640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76ac0a3240 0x7f76ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.400+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f76b00ceb80 con 0x7f76c0101420 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.400+0000 7f76c5907640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76ac0a3240 0x7f76ac0a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009900 tx=0x7f76bc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.403+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76b009bd40 con 0x7f76c0101420 2024-09-19T09:00:25.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.607+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76c006ad80 con 0x7f76c0101420 2024-09-19T09:00:25.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.608+0000 7f76b6ffd640 1 -- 172.21.15.83:0/276971207 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f76c006ad80 con 0x7f76c0101420 2024-09-19T09:00:25.608 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:25.608 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":12,"btime":"2024-09-19T09:00:24:781612+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:00:25.608 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 12 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.610+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76ac0a3240 msgr2=0x7f76ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.610+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76ac0a3240 0x7f76ac0a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009900 tx=0x7f76bc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.610+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 msgr2=0x7f76c0197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.610+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 0x7f76c0197610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b4a0 tx=0x7f76b000b960 comp rx=0 tx=0).stop 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 shutdown_connections 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76ac0a3240 0x7f76ac0a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c0106a80 0x7f76c0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76c0101420 0x7f76c0197610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 --2- 172.21.15.83:0/276971207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c0100a80 0x7f76c01970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 >> 172.21.15.83:0/276971207 conn(0x7f76c00fc7a0 msgr2=0x7f76c00fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:25.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 shutdown_connections 2024-09-19T09:00:25.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:25.611+0000 7f76c7b6b640 1 -- 172.21.15.83:0/276971207 wait complete. 2024-09-19T09:00:25.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] up:boot 2024-09-19T09:00:25.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: fsmap 11 up:standby 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: Deploying daemon mds.b on smithi122 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:25 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/276971207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] up:boot 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: fsmap 11 up:standby 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: Deploying daemon mds.b on smithi122 2024-09-19T09:00:25.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:25.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:25 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/276971207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:26.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] up:boot 2024-09-19T09:00:26.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: fsmap 11 up:standby 2024-09-19T09:00:26.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:00:26.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: Deploying daemon mds.b on smithi122 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:25 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/276971207' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:27.177 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:26 smithi122 systemd[1]: Starting Ceph mds.b for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:00:27.460 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 podman[63542]: 2024-09-19 09:00:27.079962667 +0000 UTC m=+0.015786187 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:00:27.461 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 podman[63542]: 2024-09-19 09:00:27.203761049 +0000 UTC m=+0.139584561 container create 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:00:27.960 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 podman[63542]: 2024-09-19 09:00:27.465476174 +0000 UTC m=+0.401299688 container init 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:00:27.960 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 podman[63542]: 2024-09-19 09:00:27.468377273 +0000 UTC m=+0.404200792 container start 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T09:00:27.960 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mds[63561]: -- 172.21.15.122:0/3364578910 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb3d983860 con 0x55bb3d960800 2024-09-19T09:00:27.961 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: starting mds.b at 2024-09-19T09:00:27.961 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 bash[63542]: 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 2024-09-19T09:00:27.961 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:27 smithi122 systemd[1]: Started Ceph mds.b for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:00:28.323 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:28.347 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:28.348 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:27 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:28.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:27 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:28.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:28.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:27 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:29.271 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:28 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] up:boot 2024-09-19T09:00:29.271 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:28 smithi083 ceph-mon[30926]: fsmap 12 up:standby 2024-09-19T09:00:29.271 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:28 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:00:29.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:28 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] up:boot 2024-09-19T09:00:29.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:28 smithi184 ceph-mon[35007]: fsmap 12 up:standby 2024-09-19T09:00:29.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:28 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:00:29.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:28 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] up:boot 2024-09-19T09:00:29.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:28 smithi122 ceph-mon[34247]: fsmap 12 up:standby 2024-09-19T09:00:29.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:28 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- 172.21.15.83:0/4166246619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5510102d30 msgr2=0x7f5510103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- 172.21.15.83:0/4166246619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5510102d30 0x7f5510103110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5500009cd0 tx=0x7f550002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- 172.21.15.83:0/4166246619 shutdown_connections 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- 172.21.15.83:0/4166246619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55101082a0 0x7f551010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- 172.21.15.83:0/4166246619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55101036e0 0x7f5510107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- 172.21.15.83:0/4166246619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5510102d30 0x7f5510103110 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- 172.21.15.83:0/4166246619 >> 172.21.15.83:0/4166246619 conn(0x7f55100fc7d0 msgr2=0x7f55100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- 172.21.15.83:0/4166246619 shutdown_connections 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- 172.21.15.83:0/4166246619 wait complete. 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 Processor -- start 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- start start 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5510102d30 0x7f5510198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55101036e0 0x7f5510198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 0x7f551019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.490+0000 7f5517d00640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5510111f50 con 0x7f55101082a0 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f5517d00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5510111dd0 con 0x7f55101036e0 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f5517d00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f55101120d0 con 0x7f5510102d30 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 0x7f551019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 0x7f551019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57768/0 (socket says 172.21.15.83:57768) 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 -- 172.21.15.83:0/1297564574 learned_addr learned my addr 172.21.15.83:0/1297564574 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f5515a9c640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5510102d30 0x7f5510198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551529b640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55101036e0 0x7f5510198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 -- 172.21.15.83:0/1297564574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5510102d30 msgr2=0x7f5510198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5510102d30 0x7f5510198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 -- 172.21.15.83:0/1297564574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55101036e0 msgr2=0x7f5510198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55101036e0 0x7f5510198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 -- 172.21.15.83:0/1297564574 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551019d400 con 0x7f55101082a0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f551629d640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 0x7f551019cd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f550800d750 tx=0x7f550800db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508017070 con 0x7f55101082a0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551019d6f0 con 0x7f55101082a0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55080097c0 con 0x7f55101082a0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508004b80 con 0x7f55101082a0 2024-09-19T09:00:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.491+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55101a4fd0 con 0x7f55101082a0 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.492+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551006a850 con 0x7f55101082a0 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.493+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5508004d20 con 0x7f55101082a0 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.494+0000 7f550effd640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f54f80a3240 0x7f54f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.494+0000 7f5515a9c640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f54f80a3240 0x7f54f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.494+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f55080ced60 con 0x7f55101082a0 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.494+0000 7f5515a9c640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f54f80a3240 0x7f54f80a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5500006010 tx=0x7f5500031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.498+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f550809bf20 con 0x7f55101082a0 2024-09-19T09:00:29.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.743+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f551010a2b0 con 0x7f55101082a0 2024-09-19T09:00:29.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.744+0000 7f550effd640 1 -- 172.21.15.83:0/1297564574 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7f550809b820 con 0x7f55101082a0 2024-09-19T09:00:29.744 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:29.744 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":13,"btime":"2024-09-19T09:00:27:961222+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:00:29.745 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 13 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f54f80a3240 msgr2=0x7f54f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f54f80a3240 0x7f54f80a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5500006010 tx=0x7f5500031510 comp rx=0 tx=0).stop 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 msgr2=0x7f551019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 0x7f551019cd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f550800d750 tx=0x7f550800db50 comp rx=0 tx=0).stop 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 shutdown_connections 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f54f80a3240 0x7f54f80a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55101082a0 0x7f551019cd20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55101036e0 0x7f5510198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 --2- 172.21.15.83:0/1297564574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5510102d30 0x7f5510198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 >> 172.21.15.83:0/1297564574 conn(0x7f55100fc7d0 msgr2=0x7f5510105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 shutdown_connections 2024-09-19T09:00:29.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:29.747+0000 7f5517d00640 1 -- 172.21.15.83:0/1297564574 wait complete. 2024-09-19T09:00:30.149 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1297564574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.150 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:29 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1297564574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:29 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:30.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1297564574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:30.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:29 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:30.470 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:00:31.453 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 -- 172.21.15.83:0/498980831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 msgr2=0x7fed2010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 --2- 172.21.15.83:0/498980831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed2010ea90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed18009ca0 tx=0x7fed1802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 -- 172.21.15.83:0/498980831 shutdown_connections 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 --2- 172.21.15.83:0/498980831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed2010ea90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 --2- 172.21.15.83:0/498980831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed20102790 0x7fed201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 --2- 172.21.15.83:0/498980831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed20101de0 0x7fed201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 -- 172.21.15.83:0/498980831 >> 172.21.15.83:0/498980831 conn(0x7fed200fd8c0 msgr2=0x7fed200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 -- 172.21.15.83:0/498980831 shutdown_connections 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.888+0000 7fed2588c640 1 -- 172.21.15.83:0/498980831 wait complete. 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 Processor -- start 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 -- start start 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed20101de0 0x7fed200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed20102790 0x7fed20074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed20074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111e20 con 0x7fed20106f10 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111ca0 con 0x7fed20102790 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed2588c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed20111fa0 con 0x7fed20101de0 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed1f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed20074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed1f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed20074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43828/0 (socket says 172.21.15.83:43828) 2024-09-19T09:00:31.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.889+0000 7fed1f7fe640 1 -- 172.21.15.83:0/3814902761 learned_addr learned my addr 172.21.15.83:0/3814902761 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed17fff640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed20102790 0x7fed20074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1effd640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed20101de0 0x7fed200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1f7fe640 1 -- 172.21.15.83:0/3814902761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed20101de0 msgr2=0x7fed200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1f7fe640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed20101de0 0x7fed200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1f7fe640 1 -- 172.21.15.83:0/3814902761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed20102790 msgr2=0x7fed20074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1f7fe640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed20102790 0x7fed20074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1f7fe640 1 -- 172.21.15.83:0/3814902761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed201a6680 con 0x7fed20106f10 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed1f7fe640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed20074f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed18009dc0 tx=0x7fed18003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004040 con 0x7fed20106f10 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed201a6910 con 0x7fed20106f10 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed18004690 con 0x7fed20106f10 2024-09-19T09:00:31.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18030c90 con 0x7fed20106f10 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.890+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201a6ea0 con 0x7fed20106f10 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.891+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed201021c0 con 0x7fed20106f10 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.892+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fed180041e0 con 0x7fed20106f10 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.893+0000 7fed2488a640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fed0c0a3240 0x7fed0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.893+0000 7fed1effd640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fed0c0a3240 0x7fed0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.893+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fed180f0e00 con 0x7fed20106f10 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.894+0000 7fed1effd640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fed0c0a3240 0x7fed0c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed10005e10 tx=0x7fed10005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:31.896+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed180bdfc0 con 0x7fed20106f10 2024-09-19T09:00:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.091+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fed2010a0f0 con 0x7fed20106f10 2024-09-19T09:00:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.091+0000 7fed2488a640 1 -- 172.21.15.83:0/3814902761 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7fed180bd8c0 con 0x7fed20106f10 2024-09-19T09:00:32.091 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:32.091 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-09-19T09:00:32.091 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:00:32.091 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-09-19T09:00:32.092 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-09-19T09:00:32.092 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:00:32.092 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-09-19T09:00:32.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fed0c0a3240 msgr2=0x7fed0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fed0c0a3240 0x7fed0c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed10005e10 tx=0x7fed10005da0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 msgr2=0x7fed20074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed20074f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed18009dc0 tx=0x7fed18003ba0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 shutdown_connections 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fed0c0a3240 0x7fed0c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed20106f10 0x7fed20074f70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed20102790 0x7fed20074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 --2- 172.21.15.83:0/3814902761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed20101de0 0x7fed200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 >> 172.21.15.83:0/3814902761 conn(0x7fed200fd8c0 msgr2=0x7fed200feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 shutdown_connections 2024-09-19T09:00:32.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:32.094+0000 7fed2588c640 1 -- 172.21.15.83:0/3814902761 wait complete. 2024-09-19T09:00:32.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:31 smithi083 ceph-mon[30926]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:32.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:31 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:31 smithi184 ceph-mon[35007]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:31 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:31 smithi122 ceph-mon[34247]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:31 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:32.798 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:00:32.799 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:00:33.076 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:33.197 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:32 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3814902761' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:00:33.197 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.197 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.197 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:33.197 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:33.197 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:32 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:32 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3814902761' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:00:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:33.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:33.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:32 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:32 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3814902761' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:00:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:32 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 -- 172.21.15.83:0/701894715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74102790 msgr2=0x7fcf741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 --2- 172.21.15.83:0/701894715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74102790 0x7fcf741067e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009900 tx=0x7fcf5c02a410 comp rx=0 tx=0).stop 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 -- 172.21.15.83:0/701894715 shutdown_connections 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 --2- 172.21.15.83:0/701894715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf74106f10 0x7fcf7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 --2- 172.21.15.83:0/701894715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74102790 0x7fcf741067e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 --2- 172.21.15.83:0/701894715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74101de0 0x7fcf741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:33.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 -- 172.21.15.83:0/701894715 >> 172.21.15.83:0/701894715 conn(0x7fcf740fd8c0 msgr2=0x7fcf740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 -- 172.21.15.83:0/701894715 shutdown_connections 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.571+0000 7fcf7a018640 1 -- 172.21.15.83:0/701894715 wait complete. 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 Processor -- start 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 -- start start 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 0x7fcf741984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf74102790 0x7fcf741989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74106f10 0x7fcf7419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74111e40 con 0x7fcf74101de0 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74111cc0 con 0x7fcf74106f10 2024-09-19T09:00:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf7a018640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74111fc0 con 0x7fcf74102790 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 0x7fcf741984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 0x7fcf741984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43834/0 (socket says 172.21.15.83:43834) 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 -- 172.21.15.83:0/3690478149 learned_addr learned my addr 172.21.15.83:0/3690478149 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf6bfff640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf74102790 0x7fcf741989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 -- 172.21.15.83:0/3690478149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf74102790 msgr2=0x7fcf741989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf74102790 0x7fcf741989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 -- 172.21.15.83:0/3690478149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74106f10 msgr2=0x7fcf7419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf73fff640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74106f10 0x7fcf7419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74106f10 0x7fcf7419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf737fe640 1 -- 172.21.15.83:0/3690478149 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7419d460 con 0x7fcf74101de0 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.572+0000 7fcf73fff640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74106f10 0x7fcf7419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.573+0000 7fcf737fe640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 0x7fcf741984b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c890 tx=0x7fcf6400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.573+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64004220 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.573+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf640043c0 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.573+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7419d750 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.573+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64004a00 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.573+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf741a5030 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.574+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf741021c0 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.575+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcf64004ba0 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.576+0000 7fcf717fa640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcf600a3240 0x7fcf600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.576+0000 7fcf6bfff640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcf600a3240 0x7fcf600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.576+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcf640cf1e0 con 0x7fcf74101de0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.576+0000 7fcf6bfff640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcf600a3240 0x7fcf600a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c031440 tx=0x7fcf5c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.580+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf64014030 con 0x7fcf74101de0 2024-09-19T09:00:33.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:33.752+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcf7410a0f0 con 0x7fcf74101de0 2024-09-19T09:00:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.039+0000 7fcf717fa640 1 -- 172.21.15.83:0/3690478149 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fcf6409c3a0 con 0x7fcf74101de0 2024-09-19T09:00:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-09-19T09:00:34.040 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:33 smithi083 ceph-mon[30926]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcf600a3240 msgr2=0x7fcf600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcf600a3240 0x7fcf600a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c031440 tx=0x7fcf5c0095f0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 msgr2=0x7fcf741984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 0x7fcf741984b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c890 tx=0x7fcf6400cd50 comp rx=0 tx=0).stop 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 shutdown_connections 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fcf600a3240 0x7fcf600a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf74106f10 0x7fcf7419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf74102790 0x7fcf741989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 --2- 172.21.15.83:0/3690478149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf74101de0 0x7fcf741984b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.041+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 >> 172.21.15.83:0/3690478149 conn(0x7fcf740fd8c0 msgr2=0x7fcf740fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.042+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 shutdown_connections 2024-09-19T09:00:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:34.042+0000 7fcf7a018640 1 -- 172.21.15.83:0/3690478149 wait complete. 2024-09-19T09:00:34.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:33 smithi122 ceph-mon[34247]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:34.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:33 smithi184 ceph-mon[35007]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:34.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T09:00:34.998 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:35.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:34 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3690478149' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:00:35.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:34 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3690478149' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:00:35.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:34 smithi083 ceph-mon[30926]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:00:35.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:34 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3690478149' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:00:35.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:34 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3690478149' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:00:35.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:34 smithi184 ceph-mon[35007]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:00:35.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:34 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3690478149' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:00:35.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:34 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3690478149' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:00:35.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:34 smithi122 ceph-mon[34247]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.498+0000 7f3f88512640 1 -- 172.21.15.83:0/798757790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 msgr2=0x7f3f8010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.498+0000 7f3f88512640 1 --2- 172.21.15.83:0/798757790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8010de80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009900 tx=0x7f3f7c02a480 comp rx=0 tx=0).stop 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 -- 172.21.15.83:0/798757790 shutdown_connections 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 --2- 172.21.15.83:0/798757790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8010e3c0 0x7f3f80110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 --2- 172.21.15.83:0/798757790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8010de80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 --2- 172.21.15.83:0/798757790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f80074620 0x7f3f80074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 -- 172.21.15.83:0/798757790 >> 172.21.15.83:0/798757790 conn(0x7f3f800fd8c0 msgr2=0x7f3f800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 -- 172.21.15.83:0/798757790 shutdown_connections 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.500+0000 7f3f88512640 1 -- 172.21.15.83:0/798757790 wait complete. 2024-09-19T09:00:35.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.501+0000 7f3f88512640 1 Processor -- start 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.501+0000 7f3f88512640 1 -- start start 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f80074620 0x7f3f8019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f8010e3c0 0x7f3f8019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80114060 con 0x7f3f80074f40 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80113ee0 con 0x7f3f80074620 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801141e0 con 0x7f3f8010e3c0 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43852/0 (socket says 172.21.15.83:43852) 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 -- 172.21.15.83:0/3726121986 learned_addr learned my addr 172.21.15.83:0/3726121986 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:35.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f862ae640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f80074620 0x7f3f8019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f86aaf640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f8010e3c0 0x7f3f8019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 -- 172.21.15.83:0/3726121986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f8010e3c0 msgr2=0x7f3f8019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f8010e3c0 0x7f3f8019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 -- 172.21.15.83:0/3726121986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f80074620 msgr2=0x7f3f8019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f80074620 0x7f3f8019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 -- 172.21.15.83:0/3726121986 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8019f3b0 con 0x7f3f80074f40 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f85aad640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8019a940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009850 tx=0x7f3f7c0305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c03f070 con 0x7f3f80074f40 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8019f640 con 0x7f3f80074f40 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f7c004460 con 0x7f3f80074f40 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.502+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c035030 con 0x7f3f80074f40 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.503+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801a6f80 con 0x7f3f80074f40 2024-09-19T09:00:35.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.504+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f80075cd0 con 0x7f3f80074f40 2024-09-19T09:00:35.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.505+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3f7c042070 con 0x7f3f80074f40 2024-09-19T09:00:35.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.505+0000 7f3f777fe640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3f6c0a3280 0x7f3f6c0a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:35.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.506+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f3f7c0eff10 con 0x7f3f80074f40 2024-09-19T09:00:35.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.506+0000 7f3f862ae640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3f6c0a3280 0x7f3f6c0a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:35.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.506+0000 7f3f862ae640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3f6c0a3280 0x7f3f6c0a5740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009bd0 tx=0x7f3f70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:35.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.509+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f7c0bc910 con 0x7f3f80074f40 2024-09-19T09:00:35.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:35.676+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f3f801a7310 con 0x7f3f80074f40 2024-09-19T09:00:36.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.046+0000 7f3f777fe640 1 -- 172.21.15.83:0/3726121986 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v79) ==== 171+0+0 (secure 0 0 0) 0x7f3f7c0c0c10 con 0x7f3f80074f40 2024-09-19T09:00:36.046 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3f6c0a3280 msgr2=0x7f3f6c0a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3f6c0a3280 0x7f3f6c0a5740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009bd0 tx=0x7f3f70005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 msgr2=0x7f3f8019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8019a940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009850 tx=0x7f3f7c0305d0 comp rx=0 tx=0).stop 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 shutdown_connections 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3f6c0a3280 0x7f3f6c0a5740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f8010e3c0 0x7f3f8019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f80074f40 0x7f3f8019a940 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:36.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 --2- 172.21.15.83:0/3726121986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f80074620 0x7f3f8019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:36.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.048+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 >> 172.21.15.83:0/3726121986 conn(0x7f3f800fd8c0 msgr2=0x7f3f800fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:36.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.049+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 shutdown_connections 2024-09-19T09:00:36.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:36.049+0000 7f3f88512640 1 -- 172.21.15.83:0/3726121986 wait complete. 2024-09-19T09:00:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:35 smithi184 ceph-mon[35007]: pgmap v273: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:35 smithi184 ceph-mon[35007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:00:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:35 smithi184 ceph-mon[35007]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:00:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:35 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3726121986' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T09:00:36.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:35 smithi083 ceph-mon[30926]: pgmap v273: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:36.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:35 smithi083 ceph-mon[30926]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:00:36.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:35 smithi083 ceph-mon[30926]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:00:36.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:35 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3726121986' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T09:00:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:35 smithi122 ceph-mon[34247]: pgmap v273: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:35 smithi122 ceph-mon[34247]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:00:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:35 smithi122 ceph-mon[34247]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:00:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:35 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3726121986' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T09:00:36.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:00:36.993 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:37.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:37 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3726121986' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T09:00:37.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:37 smithi083 ceph-mon[30926]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:00:37.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:37 smithi083 ceph-mon[30926]: pgmap v276: 97 pgs: 15 creating+peering, 75 unknown, 7 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:37.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:37 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3726121986' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T09:00:37.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:37 smithi184 ceph-mon[35007]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:00:37.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:37 smithi184 ceph-mon[35007]: pgmap v276: 97 pgs: 15 creating+peering, 75 unknown, 7 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:37 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3726121986' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T09:00:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:37 smithi122 ceph-mon[34247]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:00:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:37 smithi122 ceph-mon[34247]: pgmap v276: 97 pgs: 15 creating+peering, 75 unknown, 7 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 -- 172.21.15.83:0/1315372137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 msgr2=0x7fc43410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 --2- 172.21.15.83:0/1315372137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc43410ea90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009ca0 tx=0x7fc42c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 -- 172.21.15.83:0/1315372137 shutdown_connections 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 --2- 172.21.15.83:0/1315372137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc43410ea90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 --2- 172.21.15.83:0/1315372137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 0x7fc4341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 --2- 172.21.15.83:0/1315372137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc434101de0 0x7fc4341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 -- 172.21.15.83:0/1315372137 >> 172.21.15.83:0/1315372137 conn(0x7fc4340fd8c0 msgr2=0x7fc4340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 -- 172.21.15.83:0/1315372137 shutdown_connections 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.487+0000 7fc43b71b640 1 -- 172.21.15.83:0/1315372137 wait complete. 2024-09-19T09:00:37.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 Processor -- start 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 -- start start 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc434101de0 0x7fc4340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 0x7fc434074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc434074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc434111e70 con 0x7fc434106f10 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc434111cf0 con 0x7fc434101de0 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc43b71b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc434111ff0 con 0x7fc434102790 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc434074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc434074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43878/0 (socket says 172.21.15.83:43878) 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 -- 172.21.15.83:0/155898398 learned_addr learned my addr 172.21.15.83:0/155898398 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc4394b7640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc434101de0 0x7fc4340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc438cb6640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 0x7fc434074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 -- 172.21.15.83:0/155898398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 msgr2=0x7fc434074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 0x7fc434074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 -- 172.21.15.83:0/155898398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc434101de0 msgr2=0x7fc4340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc434101de0 0x7fc4340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc439cb8640 1 -- 172.21.15.83:0/155898398 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4341a67d0 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.488+0000 7fc438cb6640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 0x7fc434074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.489+0000 7fc439cb8640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc434074f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc42c031040 tx=0x7fc42c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.489+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c003ce0 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.489+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc42c0044f0 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.489+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4341a6a60 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.489+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c030c90 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.489+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4341a6ff0 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.490+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4341021c0 con 0x7fc434106f10 2024-09-19T09:00:37.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.491+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc42c0046a0 con 0x7fc434106f10 2024-09-19T09:00:37.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.491+0000 7fc4267fc640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4200a32c0 0x7fc4200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.492+0000 7fc4394b7640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4200a32c0 0x7fc4200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.492+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7fc42c0f0ee0 con 0x7fc434106f10 2024-09-19T09:00:37.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.492+0000 7fc4394b7640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4200a32c0 0x7fc4200a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc42800bbe0 tx=0x7fc42800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:37.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.495+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc42c0bddb0 con 0x7fc434106f10 2024-09-19T09:00:37.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:37.698+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc434109b60 con 0x7fc434106f10 2024-09-19T09:00:38.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.056+0000 7fc4267fc640 1 -- 172.21.15.83:0/155898398 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc42c0bd6b0 con 0x7fc434106f10 2024-09-19T09:00:38.056 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4200a32c0 msgr2=0x7fc4200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4200a32c0 0x7fc4200a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc42800bbe0 tx=0x7fc42800b390 comp rx=0 tx=0).stop 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 msgr2=0x7fc434074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc434074f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc42c031040 tx=0x7fc42c003970 comp rx=0 tx=0).stop 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 shutdown_connections 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4200a32c0 0x7fc4200a5780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc434106f10 0x7fc434074f70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc434102790 0x7fc434074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 --2- 172.21.15.83:0/155898398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc434101de0 0x7fc4340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:38.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 >> 172.21.15.83:0/155898398 conn(0x7fc4340fd8c0 msgr2=0x7fc4340feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:38.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 shutdown_connections 2024-09-19T09:00:38.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:38.059+0000 7fc43b71b640 1 -- 172.21.15.83:0/155898398 wait complete. 2024-09-19T09:00:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:38 smithi184 ceph-mon[35007]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:00:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:38 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/155898398' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:00:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:38 smithi184 ceph-mon[35007]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:00:38.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:38 smithi083 ceph-mon[30926]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:00:38.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:38 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/155898398' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:00:38.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:38 smithi083 ceph-mon[30926]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:00:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:38 smithi122 ceph-mon[34247]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:00:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:38 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/155898398' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:00:38.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:38 smithi122 ceph-mon[34247]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:00:38.771 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T09:00:38.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T09:00:39.018 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:39.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:39 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/155898398' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:00:39.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:39 smithi184 ceph-mon[35007]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:00:39.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:39 smithi184 ceph-mon[35007]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:00:39.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:39 smithi184 ceph-mon[35007]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:00:39.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:39 smithi184 ceph-mon[35007]: pgmap v279: 97 pgs: 20 creating+peering, 43 unknown, 34 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:00:39.422 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:39 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/155898398' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:00:39.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:39 smithi083 ceph-mon[30926]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:00:39.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:39 smithi083 ceph-mon[30926]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:00:39.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:39 smithi083 ceph-mon[30926]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:00:39.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:39 smithi083 ceph-mon[30926]: pgmap v279: 97 pgs: 20 creating+peering, 43 unknown, 34 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:00:39.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:39 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/155898398' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:00:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:39 smithi122 ceph-mon[34247]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:00:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:39 smithi122 ceph-mon[34247]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:00:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:39 smithi122 ceph-mon[34247]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:00:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:39 smithi122 ceph-mon[34247]: pgmap v279: 97 pgs: 20 creating+peering, 43 unknown, 34 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:00:39.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 -- 172.21.15.83:0/936504801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc41027a0 msgr2=0x7f2dc41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/936504801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc41027a0 0x7f2dc41067f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009900 tx=0x7f2db402a410 comp rx=0 tx=0).stop 2024-09-19T09:00:39.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 -- 172.21.15.83:0/936504801 shutdown_connections 2024-09-19T09:00:39.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/936504801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc4106f20 0x7f2dc410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/936504801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc41027a0 0x7f2dc41067f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/936504801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4101df0 0x7f2dc41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 -- 172.21.15.83:0/936504801 >> 172.21.15.83:0/936504801 conn(0x7f2dc40fd8f0 msgr2=0x7f2dc40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 -- 172.21.15.83:0/936504801 shutdown_connections 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.506+0000 7f2dcbee9640 1 -- 172.21.15.83:0/936504801 wait complete. 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 Processor -- start 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 -- start start 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4101df0 0x7f2dc40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc41027a0 0x7f2dc4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 0x7f2dc4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4111ed0 con 0x7f2dc4106f20 2024-09-19T09:00:39.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4111d50 con 0x7f2dc4101df0 2024-09-19T09:00:39.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dcbee9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4112050 con 0x7f2dc41027a0 2024-09-19T09:00:39.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dca486640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 0x7f2dc4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dca486640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 0x7f2dc4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43896/0 (socket says 172.21.15.83:43896) 2024-09-19T09:00:39.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.507+0000 7f2dca486640 1 -- 172.21.15.83:0/2354399239 learned_addr learned my addr 172.21.15.83:0/2354399239 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:39.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dc9484640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc41027a0 0x7f2dc4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dc9c85640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4101df0 0x7f2dc40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dca486640 1 -- 172.21.15.83:0/2354399239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc41027a0 msgr2=0x7f2dc4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dca486640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc41027a0 0x7f2dc4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dca486640 1 -- 172.21.15.83:0/2354399239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4101df0 msgr2=0x7f2dc40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dca486640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4101df0 0x7f2dc40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dca486640 1 -- 172.21.15.83:0/2354399239 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc41a6a10 con 0x7f2dc4106f20 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dc9484640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc41027a0 0x7f2dc4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dca486640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 0x7f2dc4074f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00b970 tx=0x7f2dbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc019070 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2dbc014440 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc41a6d00 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0075d0 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.508+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc41a7260 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.509+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc4102250 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.510+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2dbc01c070 con 0x7f2dc4106f20 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.511+0000 7f2dbaffd640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2db00a32c0 0x7f2db00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.511+0000 7f2dc9c85640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2db00a32c0 0x7f2db00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.511+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2dbc0ced20 con 0x7f2dc4106f20 2024-09-19T09:00:39.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.512+0000 7f2dc9c85640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2db00a32c0 0x7f2db00a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009890 tx=0x7f2dc0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.515+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2dbc09bb90 con 0x7f2dc4106f20 2024-09-19T09:00:39.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:39.690+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f2dc410a100 con 0x7f2dc4106f20 2024-09-19T09:00:40.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.083+0000 7f2dbaffd640 1 -- 172.21.15.83:0/2354399239 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7f2dbc09b490 con 0x7f2dc4106f20 2024-09-19T09:00:40.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2db00a32c0 msgr2=0x7f2db00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2db00a32c0 0x7f2db00a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009890 tx=0x7f2dc0008040 comp rx=0 tx=0).stop 2024-09-19T09:00:40.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 msgr2=0x7f2dc4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 0x7f2dc4074f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00b970 tx=0x7f2dbc00be30 comp rx=0 tx=0).stop 2024-09-19T09:00:40.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 shutdown_connections 2024-09-19T09:00:40.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2db00a32c0 0x7f2db00a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2dc4106f20 0x7f2dc4074f70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc41027a0 0x7f2dc4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 --2- 172.21.15.83:0/2354399239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2dc4101df0 0x7f2dc40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 >> 172.21.15.83:0/2354399239 conn(0x7f2dc40fd8f0 msgr2=0x7f2dc40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 shutdown_connections 2024-09-19T09:00:40.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:40.085+0000 7f2dcbee9640 1 -- 172.21.15.83:0/2354399239 wait complete. 2024-09-19T09:00:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:40 smithi184 ceph-mon[35007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:00:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:40 smithi184 ceph-mon[35007]: Cluster is now healthy 2024-09-19T09:00:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:40 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] up:active 2024-09-19T09:00:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:40 smithi184 ceph-mon[35007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:40 smithi184 ceph-mon[35007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:40.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:40 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2354399239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T09:00:40.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:40 smithi083 ceph-mon[30926]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:00:40.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:40 smithi083 ceph-mon[30926]: Cluster is now healthy 2024-09-19T09:00:40.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:40 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] up:active 2024-09-19T09:00:40.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:40 smithi083 ceph-mon[30926]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:40.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:40 smithi083 ceph-mon[30926]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:40.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:40 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2354399239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T09:00:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:40 smithi122 ceph-mon[34247]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:00:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:40 smithi122 ceph-mon[34247]: Cluster is now healthy 2024-09-19T09:00:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:40 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] up:active 2024-09-19T09:00:40.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:40 smithi122 ceph-mon[34247]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:40.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:40 smithi122 ceph-mon[34247]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:40.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:40 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2354399239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T09:00:40.792 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:00:41.037 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:41.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:41 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2354399239' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T09:00:41.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:41 smithi083 ceph-mon[30926]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:00:41.342 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:41 smithi083 ceph-mon[30926]: pgmap v281: 97 pgs: 11 creating+peering, 19 unknown, 67 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-19T09:00:41.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:41 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2354399239' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T09:00:41.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:41 smithi184 ceph-mon[35007]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:00:41.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:41 smithi184 ceph-mon[35007]: pgmap v281: 97 pgs: 11 creating+peering, 19 unknown, 67 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-19T09:00:41.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:41 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2354399239' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T09:00:41.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:41 smithi122 ceph-mon[34247]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:00:41.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:41 smithi122 ceph-mon[34247]: pgmap v281: 97 pgs: 11 creating+peering, 19 unknown, 67 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-19T09:00:41.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.536+0000 7f65b97ea640 1 -- 172.21.15.83:0/1948858048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102ef0 msgr2=0x7f65b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 --2- 172.21.15.83:0/1948858048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102ef0 0x7f65b410da40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009ca0 tx=0x7f65ac02a950 comp rx=0 tx=0).stop 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 -- 172.21.15.83:0/1948858048 shutdown_connections 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 --2- 172.21.15.83:0/1948858048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102ef0 0x7f65b410da40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 --2- 172.21.15.83:0/1948858048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b4102570 0x7f65b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 --2- 172.21.15.83:0/1948858048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65b4100e20 0x7f65b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 -- 172.21.15.83:0/1948858048 >> 172.21.15.83:0/1948858048 conn(0x7f65b40fc7d0 msgr2=0x7f65b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 -- 172.21.15.83:0/1948858048 shutdown_connections 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 -- 172.21.15.83:0/1948858048 wait complete. 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.537+0000 7f65b97ea640 1 Processor -- start 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 -- start start 2024-09-19T09:00:41.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b4100e20 0x7f65b41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 0x7f65b41998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65b4102ef0 0x7f65b41a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4110ed0 con 0x7f65b4102570 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4110d50 con 0x7f65b4102ef0 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b97ea640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65b4111050 con 0x7f65b4100e20 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 0x7f65b41998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 0x7f65b41998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58342/0 (socket says 172.21.15.83:58342) 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 -- 172.21.15.83:0/2061079624 learned_addr learned my addr 172.21.15.83:0/2061079624 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b2ffd640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b4100e20 0x7f65b41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b37fe640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65b4102ef0 0x7f65b41a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 -- 172.21.15.83:0/2061079624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b4100e20 msgr2=0x7f65b41993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b4100e20 0x7f65b41993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 -- 172.21.15.83:0/2061079624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65b4102ef0 msgr2=0x7f65b41a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65b4102ef0 0x7f65b41a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 -- 172.21.15.83:0/2061079624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b41a4960 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.538+0000 7f65b27fc640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 0x7f65b41998e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b4a0 tx=0x7f65a800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.539+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8015020 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.539+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65a8011ce0 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.539+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b41a4b30 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.539+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8010dc0 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.539+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b41a5040 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.540+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b4101280 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.541+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f65a8018020 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.541+0000 7f659bfff640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f659c0a32c0 0x7f659c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.542+0000 7f65b2ffd640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f659c0a32c0 0x7f659c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.542+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7f65a80cf720 con 0x7f65b4102570 2024-09-19T09:00:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.542+0000 7f65b2ffd640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f659c0a32c0 0x7f659c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009990 tx=0x7f65a4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.545+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65a801f020 con 0x7f65b4102570 2024-09-19T09:00:41.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:41.715+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f65b4109090 con 0x7f65b4102570 2024-09-19T09:00:42.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:42 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2061079624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:00:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:42 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2061079624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:00:42.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:42 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2061079624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:00:43.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.110+0000 7f659bfff640 1 -- 172.21.15.83:0/2061079624 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7f65a809c410 con 0x7f65b4102570 2024-09-19T09:00:43.111 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data_ec' created 2024-09-19T09:00:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.113+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f659c0a32c0 msgr2=0x7f659c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.113+0000 7f65b97ea640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f659c0a32c0 0x7f659c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009990 tx=0x7f65a4009110 comp rx=0 tx=0).stop 2024-09-19T09:00:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 msgr2=0x7f65b41998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 0x7f65b41998e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b4a0 tx=0x7f65a800b8a0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 shutdown_connections 2024-09-19T09:00:43.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f659c0a32c0 0x7f659c0a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65b4102ef0 0x7f65b41a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65b4102570 0x7f65b41998e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 --2- 172.21.15.83:0/2061079624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b4100e20 0x7f65b41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 >> 172.21.15.83:0/2061079624 conn(0x7f65b40fc7d0 msgr2=0x7f65b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.114+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 shutdown_connections 2024-09-19T09:00:43.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:43.115+0000 7f65b97ea640 1 -- 172.21.15.83:0/2061079624 wait complete. 2024-09-19T09:00:43.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:00:43.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:00:43.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T09:00:43.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T09:00:43.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T09:00:43.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:00:43.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T09:00:43.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:43 smithi184 ceph-mon[35007]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T09:00:43.460 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:00:42 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: 2024-09-19T09:00:42.971+0000 7fbd7b064640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:00:43.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:43 smithi122 ceph-mon[34247]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T09:00:43.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T09:00:43.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:43 smithi083 ceph-mon[30926]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T09:00:43.797 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T09:00:44.050 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:44.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2061079624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:00:44.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:00:44.124 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T09:00:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2061079624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:00:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:00:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T09:00:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T09:00:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T09:00:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:00:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T09:00:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:44 smithi184 ceph-mon[35007]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:00:44.450 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T09:00:44.450 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T09:00:44.450 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:00:44.450 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T09:00:44.450 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:44 smithi083 ceph-mon[30926]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:00:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2061079624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:00:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:00:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T09:00:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T09:00:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T09:00:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:00:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T09:00:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:44 smithi122 ceph-mon[34247]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:00:44.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 -- 172.21.15.83:0/3804935308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101036e0 msgr2=0x7f8c10107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:44.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 --2- 172.21.15.83:0/3804935308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101036e0 0x7f8c10107b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009930 tx=0x7f8bf802a420 comp rx=0 tx=0).stop 2024-09-19T09:00:44.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 -- 172.21.15.83:0/3804935308 shutdown_connections 2024-09-19T09:00:44.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 --2- 172.21.15.83:0/3804935308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c101082a0 0x7f8c1010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 --2- 172.21.15.83:0/3804935308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101036e0 0x7f8c10107b90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 --2- 172.21.15.83:0/3804935308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c10102d30 0x7f8c10103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.533+0000 7f8c1532b640 1 -- 172.21.15.83:0/3804935308 >> 172.21.15.83:0/3804935308 conn(0x7f8c100fc7d0 msgr2=0x7f8c100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.534+0000 7f8c1532b640 1 -- 172.21.15.83:0/3804935308 shutdown_connections 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.534+0000 7f8c1532b640 1 -- 172.21.15.83:0/3804935308 wait complete. 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.534+0000 7f8c1532b640 1 Processor -- start 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.534+0000 7f8c1532b640 1 -- start start 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c10102d30 0x7f8c10198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c101036e0 0x7f8c10198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 0x7f8c1019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8c10111ff0 con 0x7f8c101082a0 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c10111e70 con 0x7f8c101036e0 2024-09-19T09:00:44.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8c10112170 con 0x7f8c10102d30 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 0x7f8c1019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 0x7f8c1019cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58356/0 (socket says 172.21.15.83:58356) 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 -- 172.21.15.83:0/2538270628 learned_addr learned my addr 172.21.15.83:0/2538270628 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0effd640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c10102d30 0x7f8c10198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 -- 172.21.15.83:0/2538270628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c10102d30 msgr2=0x7f8c10198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0e7fc640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c101036e0 0x7f8c10198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c10102d30 0x7f8c10198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 -- 172.21.15.83:0/2538270628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c101036e0 msgr2=0x7f8c10198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c101036e0 0x7f8c10198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 -- 172.21.15.83:0/2538270628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1019d600 con 0x7f8c101082a0 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c0f7fe640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 0x7f8c1019cf20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000b970 tx=0x7f8c0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:44.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00019070 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c00014440 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1019d8f0 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c000075d0 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.535+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c101a51d0 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.536+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c10103190 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.537+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8c0001c070 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.538+0000 7f8c07fff640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8bfc0a3240 0x7f8bfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.538+0000 7f8c0effd640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8bfc0a3240 0x7f8bfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.538+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8944+0+0 (secure 0 0 0) 0x7f8c000cf700 con 0x7f8c101082a0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.539+0000 7f8c0effd640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8bfc0a3240 0x7f8bfc0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800a810 tx=0x7f8c08008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:44.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.541+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c0009c160 con 0x7f8c101082a0 2024-09-19T09:00:44.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:44.708+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8c10109d20 con 0x7f8c101082a0 2024-09-19T09:00:45.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.128+0000 7f8c07fff640 1 -- 172.21.15.83:0/2538270628 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7f8c0009ba60 con 0x7f8c101082a0 2024-09-19T09:00:45.128 INFO:teuthology.orchestra.run.smithi083.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T09:00:45.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8bfc0a3240 msgr2=0x7f8bfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8bfc0a3240 0x7f8bfc0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800a810 tx=0x7f8c08008040 comp rx=0 tx=0).stop 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 msgr2=0x7f8c1019cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 0x7f8c1019cf20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000b970 tx=0x7f8c0000be30 comp rx=0 tx=0).stop 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 shutdown_connections 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f8bfc0a3240 0x7f8bfc0a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c101082a0 0x7f8c1019cf20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c101036e0 0x7f8c10198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 --2- 172.21.15.83:0/2538270628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c10102d30 0x7f8c10198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.131+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 >> 172.21.15.83:0/2538270628 conn(0x7f8c100fc7d0 msgr2=0x7f8c10105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.132+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 shutdown_connections 2024-09-19T09:00:45.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:45.132+0000 7f8c1532b640 1 -- 172.21.15.83:0/2538270628 wait complete. 2024-09-19T09:00:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:45 smithi184 ceph-mon[35007]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:00:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:45 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2538270628' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T09:00:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:45 smithi184 ceph-mon[35007]: pgmap v286: 129 pgs: 8 creating+peering, 2 peering, 23 unknown, 96 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-09-19T09:00:45.408 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:45 smithi083 ceph-mon[30926]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:00:45.408 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:45 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2538270628' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T09:00:45.408 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:45 smithi083 ceph-mon[30926]: pgmap v286: 129 pgs: 8 creating+peering, 2 peering, 23 unknown, 96 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-09-19T09:00:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:45 smithi122 ceph-mon[34247]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:00:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:45 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2538270628' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T09:00:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:45 smithi122 ceph-mon[34247]: pgmap v286: 129 pgs: 8 creating+peering, 2 peering, 23 unknown, 96 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-09-19T09:00:45.825 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T09:00:46.083 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:46.387 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:46 smithi083 ceph-mon[30926]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:00:46.388 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:46 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2538270628' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T09:00:46.388 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:46 smithi083 ceph-mon[30926]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:00:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:46 smithi184 ceph-mon[35007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:00:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:46 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2538270628' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T09:00:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:46 smithi184 ceph-mon[35007]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:00:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:46 smithi122 ceph-mon[34247]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:00:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:46 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2538270628' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T09:00:46.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:46 smithi122 ceph-mon[34247]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:00:46.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/373527586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 msgr2=0x7fc7f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/373527586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f010ea90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009ca0 tx=0x7fc7e802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/373527586 shutdown_connections 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/373527586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f010ea90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/373527586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0102790 0x7fc7f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/373527586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f0101de0 0x7fc7f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/373527586 >> 172.21.15.83:0/373527586 conn(0x7fc7f00fd8c0 msgr2=0x7fc7f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/373527586 shutdown_connections 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.593+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/373527586 wait complete. 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 Processor -- start 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 -- start start 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f0101de0 0x7fc7f0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0102790 0x7fc7f01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0111ec0 con 0x7fc7f0106f10 2024-09-19T09:00:46.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0111d40 con 0x7fc7f0101de0 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7f4d6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0112040 con 0x7fc7f0102790 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7eed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7eed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58370/0 (socket says 172.21.15.83:58370) 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.594+0000 7fc7eed9d640 1 -- 172.21.15.83:0/312230808 learned_addr learned my addr 172.21.15.83:0/312230808 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7ee59c640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f0101de0 0x7fc7f0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7e7fff640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0102790 0x7fc7f01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7eed9d640 1 -- 172.21.15.83:0/312230808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0102790 msgr2=0x7fc7f01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7eed9d640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0102790 0x7fc7f01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7eed9d640 1 -- 172.21.15.83:0/312230808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f0101de0 msgr2=0x7fc7f0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7eed9d640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f0101de0 0x7fc7f0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7eed9d640 1 -- 172.21.15.83:0/312230808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f019d430 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7eed9d640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f019cd50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009dc0 tx=0x7fc7e8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8004040 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7e8004690 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f019d6c0 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8030d90 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.595+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01a5000 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.596+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f01021c0 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.598+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc7e80305c0 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.598+0000 7fc7e77fe640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7dc0a32c0 0x7fc7dc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.598+0000 7fc7ee59c640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7dc0a32c0 0x7fc7dc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.598+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8944+0+0 (secure 0 0 0) 0x7fc7e80f15d0 con 0x7fc7f0106f10 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.599+0000 7fc7ee59c640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7dc0a32c0 0x7fc7dc0a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009890 tx=0x7fc7e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.601+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7e803be60 con 0x7fc7f0106f10 2024-09-19T09:00:46.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:46.805+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc7f01997e0 con 0x7fc7f0106f10 2024-09-19T09:00:47.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.136+0000 7fc7e77fe640 1 -- 172.21.15.83:0/312230808 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fc7f01997e0 con 0x7fc7f0106f10 2024-09-19T09:00:47.137 INFO:teuthology.orchestra.run.smithi083.stderr:added data pool 4 to fsmap 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7dc0a32c0 msgr2=0x7fc7dc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7dc0a32c0 0x7fc7dc0a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009890 tx=0x7fc7e0008040 comp rx=0 tx=0).stop 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 msgr2=0x7fc7f019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f019cd50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009dc0 tx=0x7fc7e8003ba0 comp rx=0 tx=0).stop 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 shutdown_connections 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7dc0a32c0 0x7fc7dc0a5780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106f10 0x7fc7f019cd50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0102790 0x7fc7f01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 --2- 172.21.15.83:0/312230808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f0101de0 0x7fc7f0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 >> 172.21.15.83:0/312230808 conn(0x7fc7f00fd8c0 msgr2=0x7fc7f00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:47.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 shutdown_connections 2024-09-19T09:00:47.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:47.139+0000 7fc7f4d6e640 1 -- 172.21.15.83:0/312230808 wait complete. 2024-09-19T09:00:47.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:47 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/312230808' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T09:00:47.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:47 smithi184 ceph-mon[35007]: pgmap v288: 129 pgs: 8 creating+peering, 2 peering, 13 unknown, 106 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:47.415 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:47 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/312230808' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T09:00:47.415 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:47 smithi083 ceph-mon[30926]: pgmap v288: 129 pgs: 8 creating+peering, 2 peering, 13 unknown, 106 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:47 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/312230808' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:47 smithi122 ceph-mon[34247]: pgmap v288: 129 pgs: 8 creating+peering, 2 peering, 13 unknown, 106 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:47.914 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:48.162 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:48 smithi184 ceph-mon[35007]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:00:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:48 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/312230808' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T09:00:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:48 smithi184 ceph-mon[35007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:48.415 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:48 smithi083 ceph-mon[30926]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:00:48.415 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:48 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/312230808' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T09:00:48.415 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:48 smithi083 ceph-mon[30926]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:48 smithi122 ceph-mon[34247]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:00:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:48 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/312230808' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T09:00:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:48 smithi122 ceph-mon[34247]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:00:48.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 -- 172.21.15.83:0/3533326524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6064103660 msgr2=0x7f606410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 --2- 172.21.15.83:0/3533326524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6064103660 0x7f606410bb50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6058009900 tx=0x7f605802a480 comp rx=0 tx=0).stop 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 -- 172.21.15.83:0/3533326524 shutdown_connections 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 --2- 172.21.15.83:0/3533326524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f606410c170 0x7f606410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 --2- 172.21.15.83:0/3533326524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6064103660 0x7f606410bb50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 --2- 172.21.15.83:0/3533326524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064102d40 0x7f6064103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 -- 172.21.15.83:0/3533326524 >> 172.21.15.83:0/3533326524 conn(0x7f60640fc7a0 msgr2=0x7f60640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 -- 172.21.15.83:0/3533326524 shutdown_connections 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.628+0000 7f606a4ec640 1 -- 172.21.15.83:0/3533326524 wait complete. 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 Processor -- start 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 -- start start 2024-09-19T09:00:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6064102d40 0x7f6064198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064103660 0x7f6064198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 0x7f606419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6064111e70 con 0x7f606410c170 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6064111cf0 con 0x7f6064103660 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f606a4ec640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6064111ff0 con 0x7f6064102d40 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f6068a89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 0x7f606419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f6068a89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 0x7f606419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58384/0 (socket says 172.21.15.83:58384) 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f6068a89640 1 -- 172.21.15.83:0/2166386428 learned_addr learned my addr 172.21.15.83:0/2166386428 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f60637fe640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064103660 0x7f6064198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.629+0000 7f6063fff640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6064102d40 0x7f6064198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f6068a89640 1 -- 172.21.15.83:0/2166386428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6064102d40 msgr2=0x7f6064198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f6068a89640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6064102d40 0x7f6064198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f6068a89640 1 -- 172.21.15.83:0/2166386428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064103660 msgr2=0x7f6064198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f6068a89640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064103660 0x7f6064198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f6068a89640 1 -- 172.21.15.83:0/2166386428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606419d2f0 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f6068a89640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 0x7f606419cc10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f605c00eaa0 tx=0x7f605c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c00cdb0 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f605c005020 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c0116d0 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606419d5e0 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.630+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641a4ec0 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.631+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6064103120 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.632+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f605c0051d0 con 0x7f606410c170 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.632+0000 7f60617fa640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f604c0a32c0 0x7f604c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.633+0000 7f6063fff640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f604c0a32c0 0x7f604c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.633+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f605c0cfc80 con 0x7f606410c170 2024-09-19T09:00:48.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.633+0000 7f6063fff640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f604c0a32c0 0x7f604c0a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f60540058c0 tx=0x7f605400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:48.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.637+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f605c0d6080 con 0x7f606410c170 2024-09-19T09:00:48.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.838+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f606402d7c0 con 0x7f606410c170 2024-09-19T09:00:48.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.838+0000 7f60617fa640 1 -- 172.21.15.83:0/2166386428 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11848 (secure 0 0 0) 0x7f605c016030 con 0x7f606410c170 2024-09-19T09:00:48.840 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:48.840 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"btime":"2024-09-19T09:00:47:130520+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:00:46.806630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-19T09:00:48.840 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 17 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f604c0a32c0 msgr2=0x7f604c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f604c0a32c0 0x7f604c0a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f60540058c0 tx=0x7f605400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 msgr2=0x7f606419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 0x7f606419cc10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f605c00eaa0 tx=0x7f605c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 shutdown_connections 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f604c0a32c0 0x7f604c0a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f606410c170 0x7f606419cc10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064103660 0x7f6064198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.840+0000 7f606a4ec640 1 --2- 172.21.15.83:0/2166386428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6064102d40 0x7f6064198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.841+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 >> 172.21.15.83:0/2166386428 conn(0x7f60640fc7a0 msgr2=0x7f60640fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:48.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.841+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 shutdown_connections 2024-09-19T09:00:48.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:48.841+0000 7f606a4ec640 1 -- 172.21.15.83:0/2166386428 wait complete. 2024-09-19T09:00:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:49 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2166386428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:49 smithi184 ceph-mon[35007]: pgmap v290: 129 pgs: 5 creating+peering, 2 peering, 122 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:49.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:49 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2166386428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:49.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:49 smithi122 ceph-mon[34247]: pgmap v290: 129 pgs: 5 creating+peering, 2 peering, 122 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:49.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:49 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2166386428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:49.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:49 smithi083 ceph-mon[30926]: pgmap v290: 129 pgs: 5 creating+peering, 2 peering, 122 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:49.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:00:49.797 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:50 smithi083 ceph-mon[30926]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T09:00:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:50 smithi083 ceph-mon[30926]: Cluster is now healthy 2024-09-19T09:00:50.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.238+0000 7f00748a4640 1 -- 172.21.15.83:0/2168624814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007010c170 msgr2=0x7f007010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.238+0000 7f00748a4640 1 --2- 172.21.15.83:0/2168624814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007010c170 0x7f007010e610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0068009ca0 tx=0x7f006802a950 comp rx=0 tx=0).stop 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 -- 172.21.15.83:0/2168624814 shutdown_connections 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 --2- 172.21.15.83:0/2168624814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007010c170 0x7f007010e610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 --2- 172.21.15.83:0/2168624814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070103660 0x7f007010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 --2- 172.21.15.83:0/2168624814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070102d40 0x7f0070103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 -- 172.21.15.83:0/2168624814 >> 172.21.15.83:0/2168624814 conn(0x7f00700fc7a0 msgr2=0x7f00700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 -- 172.21.15.83:0/2168624814 shutdown_connections 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 -- 172.21.15.83:0/2168624814 wait complete. 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 Processor -- start 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.239+0000 7f00748a4640 1 -- start start 2024-09-19T09:00:50.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 0x7f0070198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070103660 0x7f00701988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007010c170 0x7f007019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0070111e60 con 0x7f0070102d40 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0070111ce0 con 0x7f007010c170 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0070111fe0 con 0x7f0070103660 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 0x7f0070198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 0x7f0070198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55170/0 (socket says 172.21.15.83:55170) 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 -- 172.21.15.83:0/1699525780 learned_addr learned my addr 172.21.15.83:0/1699525780 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006dd9b640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070103660 0x7f00701988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 -- 172.21.15.83:0/1699525780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070103660 msgr2=0x7f00701988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070103660 0x7f00701988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 -- 172.21.15.83:0/1699525780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007010c170 msgr2=0x7f007019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007010c170 0x7f007019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 -- 172.21.15.83:0/1699525780 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007019d330 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006dd9b640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070103660 0x7f00701988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f006e59c640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 0x7f0070198380 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f006000b4a0 tx=0x7f006000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060014070 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007019d620 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0060010ac0 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060017c30 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.240+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00701a4f00 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.241+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0070103120 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.242+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0060017070 con 0x7f0070102d40 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.243+0000 7f005f7fe640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f00580a3240 0x7f00580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.243+0000 7f006dd9b640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f00580a3240 0x7f00580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.243+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f00600cf090 con 0x7f0070102d40 2024-09-19T09:00:50.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.243+0000 7f006dd9b640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f00580a3240 0x7f00580a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f00700feda0 tx=0x7f0064005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:50.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.247+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f006009bad0 con 0x7f0070102d40 2024-09-19T09:00:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:50 smithi184 ceph-mon[35007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T09:00:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:50 smithi184 ceph-mon[35007]: Cluster is now healthy 2024-09-19T09:00:50.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.414+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0070107270 con 0x7f0070102d40 2024-09-19T09:00:50.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.416+0000 7f005f7fe640 1 -- 172.21.15.83:0/1699525780 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7f006009b3d0 con 0x7f0070102d40 2024-09-19T09:00:50.417 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:50.418 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:00:50.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f00580a3240 msgr2=0x7f00580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f00580a3240 0x7f00580a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f00700feda0 tx=0x7f0064005dd0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 msgr2=0x7f0070198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 0x7f0070198380 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f006000b4a0 tx=0x7f006000b960 comp rx=0 tx=0).stop 2024-09-19T09:00:50.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 shutdown_connections 2024-09-19T09:00:50.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f00580a3240 0x7f00580a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007010c170 0x7f007019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0070103660 0x7f00701988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 --2- 172.21.15.83:0/1699525780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0070102d40 0x7f0070198380 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 >> 172.21.15.83:0/1699525780 conn(0x7f00700fc7a0 msgr2=0x7f00700fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:50.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 shutdown_connections 2024-09-19T09:00:50.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:50.418+0000 7f00748a4640 1 -- 172.21.15.83:0/1699525780 wait complete. 2024-09-19T09:00:50.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:50 smithi122 ceph-mon[34247]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T09:00:50.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:50 smithi122 ceph-mon[34247]: Cluster is now healthy 2024-09-19T09:00:51.304 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:00:51.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:51 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1699525780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:51.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:51 smithi122 ceph-mon[34247]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:51.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:51 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1699525780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:51.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:51 smithi083 ceph-mon[30926]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:51.553 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:51.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:51 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1699525780' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:51.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:51 smithi184 ceph-mon[35007]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 -- 172.21.15.83:0/3700589780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880100e20 msgr2=0x7f7880101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 --2- 172.21.15.83:0/3700589780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880100e20 0x7f7880101200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7870009900 tx=0x7f787002a480 comp rx=0 tx=0).stop 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 -- 172.21.15.83:0/3700589780 shutdown_connections 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 --2- 172.21.15.83:0/3700589780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7880102ef0 0x7f788010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 --2- 172.21.15.83:0/3700589780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7880102570 0x7f78801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 --2- 172.21.15.83:0/3700589780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880100e20 0x7f7880101200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 -- 172.21.15.83:0/3700589780 >> 172.21.15.83:0/3700589780 conn(0x7f78800fc7d0 msgr2=0x7f78800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 -- 172.21.15.83:0/3700589780 shutdown_connections 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.013+0000 7f78865da640 1 -- 172.21.15.83:0/3700589780 wait complete. 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 Processor -- start 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 -- start start 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7880100e20 0x7f78801972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7880102570 0x7f7880197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 0x7f788019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7880110ea0 con 0x7f7880102ef0 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7880110d20 con 0x7f7880100e20 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f78865da640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7880111020 con 0x7f7880102570 2024-09-19T09:00:52.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f7884b77640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 0x7f788019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f7884b77640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 0x7f788019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55180/0 (socket says 172.21.15.83:55180) 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f7884b77640 1 -- 172.21.15.83:0/1635805225 learned_addr learned my addr 172.21.15.83:0/1635805225 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.014+0000 7f787ffff640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7880100e20 0x7f78801972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7877fff640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7880102570 0x7f7880197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7884b77640 1 -- 172.21.15.83:0/1635805225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7880102570 msgr2=0x7f7880197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7884b77640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7880102570 0x7f7880197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7884b77640 1 -- 172.21.15.83:0/1635805225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7880100e20 msgr2=0x7f78801972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7884b77640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7880100e20 0x7f78801972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7884b77640 1 -- 172.21.15.83:0/1635805225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788019c280 con 0x7f7880102ef0 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f7884b77640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 0x7f788019bba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f787800b970 tx=0x7f787800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878019070 con 0x7f7880102ef0 2024-09-19T09:00:52.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788019c570 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7878014440 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78780075d0 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.015+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78801a3e50 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.016+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7880101200 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.017+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f787801c070 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.018+0000 7f787dffb640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f786c0a3240 0x7f786c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.018+0000 7f787ffff640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f786c0a3240 0x7f786c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.018+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f78780cf140 con 0x7f7880102ef0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.018+0000 7f787ffff640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f786c0a3240 0x7f786c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7870000c00 tx=0x7f7870005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.022+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f787809b530 con 0x7f7880102ef0 2024-09-19T09:00:52.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.191+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78801a40b0 con 0x7f7880102ef0 2024-09-19T09:00:52.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.193+0000 7f787dffb640 1 -- 172.21.15.83:0/1635805225 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7f787809f830 con 0x7f7880102ef0 2024-09-19T09:00:52.194 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:52.194 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:00:52.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f786c0a3240 msgr2=0x7f786c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f786c0a3240 0x7f786c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7870000c00 tx=0x7f7870005e80 comp rx=0 tx=0).stop 2024-09-19T09:00:52.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 msgr2=0x7f788019bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 0x7f788019bba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f787800b970 tx=0x7f787800be30 comp rx=0 tx=0).stop 2024-09-19T09:00:52.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 shutdown_connections 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f786c0a3240 0x7f786c0a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7880102ef0 0x7f788019bba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7880102570 0x7f7880197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 --2- 172.21.15.83:0/1635805225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7880100e20 0x7f78801972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 >> 172.21.15.83:0/1635805225 conn(0x7f78800fc7d0 msgr2=0x7f78800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 shutdown_connections 2024-09-19T09:00:52.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:52.195+0000 7f78865da640 1 -- 172.21.15.83:0/1635805225 wait complete. 2024-09-19T09:00:52.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:52 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1635805225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:52.551 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:52 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1635805225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:52.638 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:52 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1635805225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:53.022 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:53.276 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:53.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:53 smithi083 ceph-mon[30926]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:53.567 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:53 smithi184 ceph-mon[35007]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:53.598 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:53 smithi122 ceph-mon[34247]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 -- 172.21.15.83:0/391736982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670101420 msgr2=0x7f767010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 --2- 172.21.15.83:0/391736982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670101420 0x7f767010d950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7668009930 tx=0x7f766802a420 comp rx=0 tx=0).stop 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 -- 172.21.15.83:0/391736982 shutdown_connections 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 --2- 172.21.15.83:0/391736982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670101420 0x7f767010d950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 --2- 172.21.15.83:0/391736982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7670100a80 0x7f7670100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 --2- 172.21.15.83:0/391736982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7670106a80 0x7f7670106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 -- 172.21.15.83:0/391736982 >> 172.21.15.83:0/391736982 conn(0x7f76700fc7a0 msgr2=0x7f76700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 -- 172.21.15.83:0/391736982 shutdown_connections 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.738+0000 7f7675b15640 1 -- 172.21.15.83:0/391736982 wait complete. 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.739+0000 7f7675b15640 1 Processor -- start 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.739+0000 7f7675b15640 1 -- start start 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 0x7f7670197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7670101420 0x7f7670197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7670106a80 0x7f767019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7670110d30 con 0x7f7670100a80 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7670110bb0 con 0x7f7670106a80 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7670110eb0 con 0x7f7670101420 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 0x7f7670197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 0x7f7670197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55204/0 (socket says 172.21.15.83:55204) 2024-09-19T09:00:53.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 -- 172.21.15.83:0/2074872933 learned_addr learned my addr 172.21.15.83:0/2074872933 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766effd640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7670101420 0x7f7670197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766ffff640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7670106a80 0x7f767019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 -- 172.21.15.83:0/2074872933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7670101420 msgr2=0x7f7670197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7670101420 0x7f7670197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 -- 172.21.15.83:0/2074872933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7670106a80 msgr2=0x7f767019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7670106a80 0x7f767019bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 -- 172.21.15.83:0/2074872933 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767019c1e0 con 0x7f7670100a80 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766f7fe640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 0x7f7670197230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f766000cce0 tx=0x7f766000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660004b20 con 0x7f7670100a80 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7660004cc0 con 0x7f7670100a80 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767019c4d0 con 0x7f7670100a80 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766000f6b0 con 0x7f7670100a80 2024-09-19T09:00:53.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.740+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76701a3db0 con 0x7f7670100a80 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.741+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7670100ee0 con 0x7f7670100a80 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.742+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f766000f850 con 0x7f7670100a80 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.743+0000 7f766cff9640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76580a3240 0x7f76580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.743+0000 7f766effd640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76580a3240 0x7f76580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.743+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f76600cfc60 con 0x7f7670100a80 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.744+0000 7f766effd640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76580a3240 0x7f76580a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76700fede0 tx=0x7f766400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.747+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7660014030 con 0x7f7670100a80 2024-09-19T09:00:53.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.946+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7670198590 con 0x7f7670100a80 2024-09-19T09:00:53.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.947+0000 7f766cff9640 1 -- 172.21.15.83:0/2074872933 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11848 (secure 0 0 0) 0x7f766009c6a0 con 0x7f7670100a80 2024-09-19T09:00:53.948 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:53.948 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"btime":"2024-09-19T09:00:47:130520+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:00:46.806630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-19T09:00:53.948 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 17 2024-09-19T09:00:53.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76580a3240 msgr2=0x7f76580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76580a3240 0x7f76580a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76700fede0 tx=0x7f766400b390 comp rx=0 tx=0).stop 2024-09-19T09:00:53.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 msgr2=0x7f7670197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 0x7f7670197230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f766000cce0 tx=0x7f766000a620 comp rx=0 tx=0).stop 2024-09-19T09:00:53.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 shutdown_connections 2024-09-19T09:00:53.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f76580a3240 0x7f76580a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7670106a80 0x7f767019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7670101420 0x7f7670197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 --2- 172.21.15.83:0/2074872933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7670100a80 0x7f7670197230 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 >> 172.21.15.83:0/2074872933 conn(0x7f76700fc7a0 msgr2=0x7f76700fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 shutdown_connections 2024-09-19T09:00:53.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:53.949+0000 7f7675b15640 1 -- 172.21.15.83:0/2074872933 wait complete. 2024-09-19T09:00:54.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:54 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2074872933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:54.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:54 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2074872933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:54.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:54 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2074872933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:54.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:55.438 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:55 smithi083 ceph-mon[30926]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 -- 172.21.15.83:0/3324756993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4106a80 msgr2=0x7f83e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/3324756993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4106a80 0x7f83e4106e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009930 tx=0x7f83d402a420 comp rx=0 tx=0).stop 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 -- 172.21.15.83:0/3324756993 shutdown_connections 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/3324756993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4101420 0x7f83e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/3324756993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e4100a80 0x7f83e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/3324756993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4106a80 0x7f83e4106e60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 -- 172.21.15.83:0/3324756993 >> 172.21.15.83:0/3324756993 conn(0x7f83e40fc7a0 msgr2=0x7f83e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 -- 172.21.15.83:0/3324756993 shutdown_connections 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.517+0000 7f83e8cc5640 1 -- 172.21.15.83:0/3324756993 wait complete. 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 Processor -- start 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 -- start start 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e4100a80 0x7f83e4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 0x7f83e4198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4106a80 0x7f83e419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4110d30 con 0x7f83e4101420 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4110bb0 con 0x7f83e4106a80 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e8cc5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4110eb0 con 0x7f83e4100a80 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 0x7f83e4198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 0x7f83e4198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55220/0 (socket says 172.21.15.83:55220) 2024-09-19T09:00:55.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 -- 172.21.15.83:0/1249567059 learned_addr learned my addr 172.21.15.83:0/1249567059 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e259c640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e4100a80 0x7f83e4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e2d9d640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4106a80 0x7f83e419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 -- 172.21.15.83:0/1249567059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e4100a80 msgr2=0x7f83e4198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e4100a80 0x7f83e4198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 -- 172.21.15.83:0/1249567059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4106a80 msgr2=0x7f83e419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4106a80 0x7f83e419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e1d9b640 1 -- 172.21.15.83:0/1249567059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e419d1e0 con 0x7f83e4101420 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.518+0000 7f83e2d9d640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4106a80 0x7f83e419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.519+0000 7f83e1d9b640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 0x7f83e4198770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c920 tx=0x7f83d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.519+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8007c70 con 0x7f83e4101420 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.519+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83d8007e10 con 0x7f83e4101420 2024-09-19T09:00:55.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.519+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e419d4d0 con 0x7f83e4101420 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.519+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8018820 con 0x7f83e4101420 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.519+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e41a4db0 con 0x7f83e4101420 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.520+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e4100ee0 con 0x7f83e4101420 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.521+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f83d80189c0 con 0x7f83e4101420 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.522+0000 7f83d37fe640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f83cc0a3240 0x7f83cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.522+0000 7f83e259c640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f83cc0a3240 0x7f83cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.522+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f83d80d0010 con 0x7f83e4101420 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.522+0000 7f83e259c640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f83cc0a3240 0x7f83cc0a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006010 tx=0x7f83d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.525+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83d8014030 con 0x7f83e4101420 2024-09-19T09:00:55.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:55 smithi184 ceph-mon[35007]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.691+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83e4199590 con 0x7f83e4101420 2024-09-19T09:00:55.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.693+0000 7f83d37fe640 1 -- 172.21.15.83:0/1249567059 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7f83e4199590 con 0x7f83e4101420 2024-09-19T09:00:55.693 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:00:55.693 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:00:55.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f83cc0a3240 msgr2=0x7f83cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f83cc0a3240 0x7f83cc0a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006010 tx=0x7f83d4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 msgr2=0x7f83e4198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 0x7f83e4198770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c920 tx=0x7f83d800cde0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 shutdown_connections 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f83cc0a3240 0x7f83cc0a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83e4106a80 0x7f83e419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83e4101420 0x7f83e4198770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 --2- 172.21.15.83:0/1249567059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e4100a80 0x7f83e4198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 >> 172.21.15.83:0/1249567059 conn(0x7f83e40fc7a0 msgr2=0x7f83e406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 shutdown_connections 2024-09-19T09:00:55.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:55.695+0000 7f83e8cc5640 1 -- 172.21.15.83:0/1249567059 wait complete. 2024-09-19T09:00:55.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:55 smithi122 ceph-mon[34247]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-19T09:00:56.528 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:56 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1249567059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:56.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:00:37.699557+0000', 'modified': '2024-09-19T09:00:46.806630+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.122:6839/1686011933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 1686011933}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 1686011933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24476, 'qdb_cluster': [24476]} 2024-09-19T09:00:56.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:00:56.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:00:56.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:56 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1249567059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:56.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:56 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1249567059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:00:56.773 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:57.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 -- 172.21.15.83:0/1940679420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44105f40 msgr2=0x7f2b441063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 --2- 172.21.15.83:0/1940679420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44105f40 0x7f2b441063d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009ca0 tx=0x7f2b3c02a940 comp rx=0 tx=0).stop 2024-09-19T09:00:57.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 -- 172.21.15.83:0/1940679420 shutdown_connections 2024-09-19T09:00:57.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 --2- 172.21.15.83:0/1940679420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44105f40 0x7f2b441063d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 --2- 172.21.15.83:0/1940679420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b44101450 0x7f2b44105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 --2- 172.21.15.83:0/1940679420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b44100b30 0x7f2b44100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 -- 172.21.15.83:0/1940679420 >> 172.21.15.83:0/1940679420 conn(0x7f2b440fc7a0 msgr2=0x7f2b440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 -- 172.21.15.83:0/1940679420 shutdown_connections 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.244+0000 7f2b49567640 1 -- 172.21.15.83:0/1940679420 wait complete. 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 Processor -- start 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 -- start start 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 0x7f2b441a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b44101450 0x7f2b441a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b44105f40 0x7f2b4419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44118470 con 0x7f2b44100b30 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441182f0 con 0x7f2b44101450 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b49567640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441185f0 con 0x7f2b44105f40 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.245+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 0x7f2b441a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 0x7f2b441a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55234/0 (socket says 172.21.15.83:55234) 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 -- 172.21.15.83:0/1917140857 learned_addr learned my addr 172.21.15.83:0/1917140857 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b427fc640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b44101450 0x7f2b441a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 -- 172.21.15.83:0/1917140857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b44105f40 msgr2=0x7f2b4419e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b44105f40 0x7f2b4419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 -- 172.21.15.83:0/1917140857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b44101450 msgr2=0x7f2b441a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b44101450 0x7f2b441a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 -- 172.21.15.83:0/1917140857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4419efb0 con 0x7f2b44100b30 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 0x7f2b441a4670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400c920 tx=0x7f2b3400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b2bfff640 1 -- 172.21.15.83:0/1917140857 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34007c70 con 0x7f2b44100b30 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b2bfff640 1 -- 172.21.15.83:0/1917140857 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b34007e10 con 0x7f2b44100b30 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4419f2a0 con 0x7f2b44100b30 2024-09-19T09:00:57.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b2bfff640 1 -- 172.21.15.83:0/1917140857 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34018820 con 0x7f2b44100b30 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.246+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441ab5f0 con 0x7f2b44100b30 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b2bfff640 1 -- 172.21.15.83:0/1917140857 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2b340189c0 con 0x7f2b44100b30 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 Processor -- start 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 -- start start 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b6edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b79670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b7bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5583a6ad5090 con 0x5583a6b79bb0 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5583a6a7ca70 con 0x5583a6b6f2f0 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b4b940740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583a6ad1050 con 0x5583a6b6e9d0 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.249+0000 7f2b427fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b7bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b7bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55246/0 (socket says 172.21.15.83:55246) 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 -- 172.21.15.83:0/1465410886 learned_addr learned my addr 172.21.15.83:0/1465410886 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b79670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b6edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b2bfff640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b2c0a3240 0x7f2b2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 -- 172.21.15.83:0/1465410886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 msgr2=0x5583a6b6edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b6edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 -- 172.21.15.83:0/1465410886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 msgr2=0x5583a6b79670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b79670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 -- 172.21.15.83:0/1465410886 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a6a89130 con 0x5583a6b79bb0 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b6edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b2c0a3240 0x7f2b2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b79670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b2bfff640 1 -- 172.21.15.83:0/1917140857 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f2b340cfe10 con 0x7f2b44100b30 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b427fc640 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b7bfa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2b38007740 tx=0x7f2b38007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a0c522f15c4817 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b297fa640 1 -- 172.21.15.83:0/1465410886 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38007e50 con 0x5583a6b79bb0 2024-09-19T09:00:57.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b297fa640 1 -- 172.21.15.83:0/1465410886 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b38018070 con 0x5583a6b79bb0 2024-09-19T09:00:57.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.250+0000 7f2b297fa640 1 -- 172.21.15.83:0/1465410886 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38013e60 con 0x5583a6b79bb0 2024-09-19T09:00:57.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 -- 172.21.15.83:0/1465410886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 msgr2=0x5583a6b7bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b7bfa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2b38007740 tx=0x7f2b38007c00 comp rx=0 tx=0).stop 2024-09-19T09:00:57.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b2c0a3240 0x7f2b2c0a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c004af0 tx=0x7f2b3c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:57.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 -- 172.21.15.83:0/1465410886 shutdown_connections 2024-09-19T09:00:57.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b7bfa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b79670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1465410886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b6edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 -- 172.21.15.83:0/1465410886 >> 172.21.15.83:0/1465410886 conn(0x5583a6b6af60 msgr2=0x5583a6b6b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:57.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 -- 172.21.15.83:0/1465410886 shutdown_connections 2024-09-19T09:00:57.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 -- 172.21.15.83:0/1465410886 wait complete. 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.251+0000 7f2b4b940740 1 -- start start 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 Processor -- start 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 0x5583a6b793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b76700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b76c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b7c780 con 0x5583a6b6e9d0 2024-09-19T09:00:57.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5583a6a8ff20 con 0x5583a6b6f2f0 2024-09-19T09:00:57.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b7c900 con 0x5583a6b79bb0 2024-09-19T09:00:57.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b4b940740 10 client.0 _ll_register_callbacks cb 0x5583a6a59030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:57.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 0x5583a6b793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 0x5583a6b793b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55258/0 (socket says 172.21.15.83:55258) 2024-09-19T09:00:57.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 -- 172.21.15.83:0/2038387016 learned_addr learned my addr 172.21.15.83:0/2038387016 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:57.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b437fe640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b76c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b427fc640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b76700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 -- 172.21.15.83:0/2038387016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 msgr2=0x5583a6b76c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b76c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 -- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 msgr2=0x5583a6b76700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b76700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 -- 172.21.15.83:0/2038387016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a68462b0 con 0x5583a6b6e9d0 2024-09-19T09:00:57.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b427fc640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b76700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:57.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 0x5583a6b793b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b3409be50 tx=0x7f2b34018cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8055029c9a93d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:57.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.252+0000 7f2b26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:00:57.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b26ff5640 1 -- 172.21.15.83:0/2038387016 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3409c150 con 0x5583a6b6e9d0 2024-09-19T09:00:57.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b26ff5640 1 -- 172.21.15.83:0/2038387016 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f2b340bc0b0 con 0x5583a6b6e9d0 2024-09-19T09:00:57.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b38018070 con 0x5583a6b6e9d0 2024-09-19T09:00:57.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b26ff5640 1 -- 172.21.15.83:0/2038387016 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2b340b5150 con 0x5583a6b6e9d0 2024-09-19T09:00:57.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 10 client.14688 fetch_fsmap learned FSMap version 17 2024-09-19T09:00:57.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5583a6b88010 con 0x5583a6b6e9d0 2024-09-19T09:00:57.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b26ff5640 1 -- 172.21.15.83:0/2038387016 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b38018070 con 0x5583a6b6e9d0 2024-09-19T09:00:57.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b26ff5640 1 -- 172.21.15.83:0/2038387016 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f2b340a4930 con 0x5583a6b6e9d0 2024-09-19T09:00:57.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 10 client.14688 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T09:00:57.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 10 client.14688 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:00:57.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 20 client.14688 populate_metadata read hostname 'smithi083' 2024-09-19T09:00:57.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6b8a640 0x5583a6b8bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 4 client.14688 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:57.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 --> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583a6ae2600 con 0x5583a6b8a640 2024-09-19T09:00:57.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.253+0000 7f2b427fc640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6b8a640 0x5583a6b8bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.254+0000 7f2b26ff5640 10 client.14688 ms_handle_connect on v2:172.21.15.122:6838/1686011933 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.254+0000 7f2b427fc640 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6b8a640 0x5583a6b8bab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5cee6aceddd0348 server_cookie=2f162c29f502f5bd in_seq=0 out_seq=0 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b26ff5640 1 -- 172.21.15.83:0/2038387016 <== mds.0 v2:172.21.15.122:6838/1686011933 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583a6ae2600 con 0x5583a6b8a640 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b26ff5640 10 client.14688 handle_command_reply: tid=0 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 client.14688 shutdown 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 msgr2=0x5583a6b793b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 0x5583a6b793b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b3409be50 tx=0x7f2b34018cb0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 shutdown_connections 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6b8a640 0x5583a6b8bab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b76c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b76700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b26ff5640 0 client.14688 ms_handle_reset on v2:172.21.15.122:6838/1686011933 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 --2- 172.21.15.83:0/2038387016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6e9d0 0x5583a6b793b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 >> 172.21.15.83:0/2038387016 conn(0x5583a6b6af60 msgr2=0x5583a6b70c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 shutdown_connections 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 1 -- 172.21.15.83:0/2038387016 wait complete. 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.255+0000 7f2b4b940740 20 client.14688 trim_cache size 0 max 16384 2024-09-19T09:00:57.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 Processor -- start 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 -- start start 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b89f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b89df0 con 0x5583a6b79bb0 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b8a4c0 con 0x5583a6b6f2f0 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b4b940740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b8ab90 con 0x5583a6b6e9d0 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b427fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b766c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55272/0 (socket says 172.21.15.83:55272) 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b437fe640 1 -- 172.21.15.83:0/1487891493 learned_addr learned my addr 172.21.15.83:0/1487891493 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.273+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b89f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b437fe640 1 -- 172.21.15.83:0/1487891493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 msgr2=0x5583a6b89f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b89f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b437fe640 1 -- 172.21.15.83:0/1487891493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 msgr2=0x5583a6b8b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b437fe640 1 -- 172.21.15.83:0/1487891493 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a6b6fee0 con 0x5583a6b79bb0 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b437fe640 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b766c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c035000 tx=0x7f2b3c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68eddaa00ba5985 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b28ff9640 1 -- 172.21.15.83:0/1487891493 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c034040 con 0x5583a6b79bb0 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b28ff9640 1 -- 172.21.15.83:0/1487891493 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b3c030af0 con 0x5583a6b79bb0 2024-09-19T09:00:57.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.274+0000 7f2b28ff9640 1 -- 172.21.15.83:0/1487891493 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c0045d0 con 0x5583a6b79bb0 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- 172.21.15.83:0/1487891493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 msgr2=0x5583a6b766c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b766c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c035000 tx=0x7f2b3c03d000 comp rx=0 tx=0).stop 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- 172.21.15.83:0/1487891493 shutdown_connections 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b79bb0 0x5583a6b766c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- 172.21.15.83:0/1487891493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b6e9d0 0x5583a6b89f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- 172.21.15.83:0/1487891493 >> 172.21.15.83:0/1487891493 conn(0x5583a6b6af60 msgr2=0x5583a6b65ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- 172.21.15.83:0/1487891493 shutdown_connections 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- 172.21.15.83:0/1487891493 wait complete. 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- start start 2024-09-19T09:00:57.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 Processor -- start 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6e9d0 0x5583a6b8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b8d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b8b930 con 0x5583a6b6f2f0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b8b260 con 0x5583a6b6e9d0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.275+0000 7f2b4b940740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583a6b8c000 con 0x5583a6b79bb0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b4b940740 10 client.0 _ll_register_callbacks cb 0x7f2b3409bc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55286/0 (socket says 172.21.15.83:55286) 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 -- 172.21.15.83:0/3110207838 learned_addr learned my addr 172.21.15.83:0/3110207838 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b437fe640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b8d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6e9d0 0x5583a6b8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 -- 172.21.15.83:0/3110207838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 msgr2=0x5583a6b8d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b8d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 -- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6e9d0 msgr2=0x5583a6b8cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6e9d0 0x5583a6b8cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 -- 172.21.15.83:0/3110207838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a6bf2d40 con 0x5583a6b6f2f0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6e9d0 0x5583a6b8cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b427fc640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000c00 tx=0x7f2b38013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaeaaabffd385802 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b26ff5640 1 -- 172.21.15.83:0/3110207838 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38013cc0 con 0x5583a6b6f2f0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b26ff5640 1 -- 172.21.15.83:0/3110207838 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f2b3800d950 con 0x5583a6b6f2f0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b3c030af0 con 0x5583a6b6f2f0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b26ff5640 1 -- 172.21.15.83:0/3110207838 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2b38032050 con 0x5583a6b6f2f0 2024-09-19T09:00:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b4b940740 10 client.14694 fetch_fsmap learned FSMap version 17 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.276+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5583a6bf4040 con 0x5583a6b6f2f0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b26ff5640 1 -- 172.21.15.83:0/3110207838 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b3c030af0 con 0x5583a6b6f2f0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b26ff5640 1 -- 172.21.15.83:0/3110207838 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f2b3801d9d0 con 0x5583a6b6f2f0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b4b940740 10 client.14694 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b4b940740 10 client.14694 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b4b940740 20 client.14694 populate_metadata read hostname 'smithi083' 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b4b940740 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6bf8ae0 0x5583a6bf77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b4b940740 4 client.14694 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 --> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] -- command(tid 0: {"prefix": "status"}) -- 0x5583a6adcb10 con 0x5583a6bf8ae0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.277+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6bf8ae0 0x5583a6bf77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b42ffd640 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6bf8ae0 0x5583a6bf77f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1df93db1b49e4bda server_cookie=7c263c47f3e80c67 in_seq=0 out_seq=0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b26ff5640 10 client.14694 ms_handle_connect on v2:172.21.15.122:6838/1686011933 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b26ff5640 1 -- 172.21.15.83:0/3110207838 <== mds.0 v2:172.21.15.122:6838/1686011933 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5583a6adcb10 con 0x5583a6bf8ae0 2024-09-19T09:00:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b26ff5640 10 client.14694 handle_command_reply: tid=0 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 client.14694 shutdown 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 msgr2=0x5583a6b8d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000c00 tx=0x7f2b38013730 comp rx=0 tx=0).stop 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 shutdown_connections 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5583a6bf8ae0 0x5583a6bf77f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583a6b79bb0 0x5583a6b8d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5583a6b6f2f0 0x5583a6b8d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b26ff5640 0 client.14694 ms_handle_reset on v2:172.21.15.122:6838/1686011933 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 --2- 172.21.15.83:0/3110207838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583a6b6e9d0 0x5583a6b8cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 >> 172.21.15.83:0/3110207838 conn(0x5583a6b6af60 msgr2=0x5583a6b89d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 shutdown_connections 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 1 -- 172.21.15.83:0/3110207838 wait complete. 2024-09-19T09:00:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.278+0000 7f2b4b940740 20 client.14694 trim_cache size 0 max 16384 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24476, 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:00:57.300 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 19.219969915, 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 17, 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 87, 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 29.785122252000001 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:00:57.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b2c0a3240 msgr2=0x7f2b2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b2c0a3240 0x7f2b2c0a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c004af0 tx=0x7f2b3c004a40 comp rx=0 tx=0).stop 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 msgr2=0x7f2b441a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 0x7f2b441a4670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400c920 tx=0x7f2b3400cde0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 shutdown_connections 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b2c0a3240 0x7f2b2c0a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b44105f40 0x7f2b4419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b44101450 0x7f2b441a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 --2- 172.21.15.83:0/1917140857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b44100b30 0x7f2b441a4670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 >> 172.21.15.83:0/1917140857 conn(0x7f2b440fc7a0 msgr2=0x7f2b441038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 shutdown_connections 2024-09-19T09:00:57.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:57.279+0000 7f2b49567640 1 -- 172.21.15.83:0/1917140857 wait complete. 2024-09-19T09:00:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:57 smithi083 ceph-mon[30926]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:57.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:57 smithi184 ceph-mon[35007]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:57.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:57 smithi122 ceph-mon[34247]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:00:57.999 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:00:58.000 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:00:58.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:00:58.243 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:58.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- 172.21.15.83:0/2079274634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15941027a0 msgr2=0x7f15941067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- 172.21.15.83:0/2079274634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15941027a0 0x7f15941067f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f157c009900 tx=0x7f157c02a410 comp rx=0 tx=0).stop 2024-09-19T09:00:58.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- 172.21.15.83:0/2079274634 shutdown_connections 2024-09-19T09:00:58.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- 172.21.15.83:0/2079274634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1594106f20 0x7f159410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- 172.21.15.83:0/2079274634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15941027a0 0x7f15941067f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- 172.21.15.83:0/2079274634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1594101df0 0x7f15941021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- 172.21.15.83:0/2079274634 >> 172.21.15.83:0/2079274634 conn(0x7f15940fd8f0 msgr2=0x7f15940ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- 172.21.15.83:0/2079274634 shutdown_connections 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- 172.21.15.83:0/2079274634 wait complete. 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 Processor -- start 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- start start 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 0x7f1594198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15941027a0 0x7f1594198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1594106f20 0x7f159419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1594111f20 con 0x7f1594101df0 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1594111da0 con 0x7f1594106f20 2024-09-19T09:00:58.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.711+0000 7f159a97e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15941120a0 con 0x7f15941027a0 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 0x7f1594198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 0x7f1594198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55300/0 (socket says 172.21.15.83:55300) 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 -- 172.21.15.83:0/3196988605 learned_addr learned my addr 172.21.15.83:0/3196988605 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f158bfff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15941027a0 0x7f1594198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 -- 172.21.15.83:0/3196988605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15941027a0 msgr2=0x7f1594198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15941027a0 0x7f1594198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 -- 172.21.15.83:0/3196988605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1594106f20 msgr2=0x7f159419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1594106f20 0x7f159419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 -- 172.21.15.83:0/3196988605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159419d4d0 con 0x7f1594101df0 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f158bfff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15941027a0 0x7f1594198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1593fff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 0x7f1594198520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f158400b4a0 tx=0x7f158400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584014070 con 0x7f1594101df0 2024-09-19T09:00:58.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159419d7c0 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1584010ac0 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584017c30 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.712+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15941a50a0 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.713+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1594102250 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.714+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1584017070 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.715+0000 7f1591ffb640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15800a3240 0x7f15800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.715+0000 7f158bfff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15800a3240 0x7f15800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.715+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f15840cf0a0 con 0x7f1594101df0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.715+0000 7f158bfff640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15800a3240 0x7f15800a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f157c005ab0 tx=0x7f157c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.719+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f158409bae0 con 0x7f1594101df0 2024-09-19T09:00:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.924+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f159402d7c0 con 0x7f1594101df0 2024-09-19T09:00:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.925+0000 7f1591ffb640 1 -- 172.21.15.83:0/3196988605 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f158409b3e0 con 0x7f1594101df0 2024-09-19T09:00:58.925 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T09:00:58.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.926+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15800a3240 msgr2=0x7f15800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.926+0000 7f159a97e640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15800a3240 0x7f15800a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f157c005ab0 tx=0x7f157c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.926+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 msgr2=0x7f1594198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.926+0000 7f159a97e640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 0x7f1594198520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f158400b4a0 tx=0x7f158400b960 comp rx=0 tx=0).stop 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 shutdown_connections 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f15800a3240 0x7f15800a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1594106f20 0x7f159419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15941027a0 0x7f1594198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 --2- 172.21.15.83:0/3196988605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1594101df0 0x7f1594198520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 >> 172.21.15.83:0/3196988605 conn(0x7f15940fd8f0 msgr2=0x7f15940fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 shutdown_connections 2024-09-19T09:00:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:58.927+0000 7f159a97e640 1 -- 172.21.15.83:0/3196988605 wait complete. 2024-09-19T09:00:59.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:58 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3196988605' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:58 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3196988605' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:58 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3196988605' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:59.626 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:00:59.626 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:00:59.626 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-19T09:00:59.626 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T09:00:59.626 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:00:59.627 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:00:59.627 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:00:59.627 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:00:59.627 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T09:00:59.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:59.628 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42306sec preferred_lft 42306sec 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-19T09:00:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:59.647 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:00:59.647 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:59.647 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:00:59.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:00:59.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-09-19T09:00:59.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-09-19T09:00:59.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:00:59.648 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:00:59.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:59.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:00:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:59.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:59.877 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:00:59.902 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-19T09:00:59.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:59.903 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-19T09:00:59.985 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-19T09:00:59.985 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:00:59.985 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:00:59.985 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:00:59.986 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:00:59.986 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:59.986 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:00:59.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:00:59.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:00:59.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:00:59.986 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:01:00.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:01:00.082 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:00:59 smithi083 ceph-mon[30926]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:00.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:01:00.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:00.307 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-19T09:01:00.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:00.323 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-19T09:01:00.378 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:01:00.378 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:01:00.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:00.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T09:01:00.378 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:01:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:00:59 smithi184 ceph-mon[35007]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:00.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:00:59 smithi122 ceph-mon[34247]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:00.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:01:00.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:01:00.497 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T09:01:00.498 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:01:00.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:01:00.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:01:00.625 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:01:00.625 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:01:00.625 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-19T09:01:00.625 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:01:00.625 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:01:00.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:01:00.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:01:00.701 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T09:01:00.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:01:00.701 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:00.716 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T09:01:00.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:01:00.717 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:00.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-19T09:01:00.839 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:01:00.895 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-19T09:01:00.895 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-19T09:01:00.895 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-19T09:01:00.895 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-19T09:01:00.896 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a94076573254de4ee7877abdca91a9fbcd8633397bc24587600354963a49b78/merged 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b2b9f52c14d141656fa551307d0ddde5b5005d513d8f31f3f2c12e2cf80951e0/merged 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-19T09:01:00.897 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/879e9c96c4b0890cc1c6cb240f1d5177aefbd36f3d4013329d6713ec5f41a365/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/68008f9fe1b27ed5a97122982ca3c24a773a950dcb50473c6f338a7c5ca8dceb/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/7bb2bd87d5865fa33e7d4c6c950a06da4371e0a9926ec60b51d75a9a2f5b2fc8/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a35844aba5fe83ed148afdca6b7bb0cbe8c7e918c6c5049cd982e4c8640b18e/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/cd3b3ca72de89aa96a5bee33b0a627cd7501db9051ef2384729f17624a0f0621/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/dde44b704ca8b52479bb05f6c25a7896c615208097c752e75c00f38642d0522b/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f55040730f2aee6c2f43802dc1b3c6ac0dd51388b2c5b9661af838c2ad18931a/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/3b56e8a0a085a9aa2d47c664e8be96d2f324a3cfe3f752d39dc03ee358762263/merged 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:00.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:00.899 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-19T09:01:00.951 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T09:01:00.951 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T09:01:00.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-19T09:01:01.018 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:01:01.075 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-19T09:01:01.075 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-19T09:01:01.075 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-19T09:01:01.076 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a94076573254de4ee7877abdca91a9fbcd8633397bc24587600354963a49b78/merged 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b2b9f52c14d141656fa551307d0ddde5b5005d513d8f31f3f2c12e2cf80951e0/merged 2024-09-19T09:01:01.077 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/879e9c96c4b0890cc1c6cb240f1d5177aefbd36f3d4013329d6713ec5f41a365/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/68008f9fe1b27ed5a97122982ca3c24a773a950dcb50473c6f338a7c5ca8dceb/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/7bb2bd87d5865fa33e7d4c6c950a06da4371e0a9926ec60b51d75a9a2f5b2fc8/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a35844aba5fe83ed148afdca6b7bb0cbe8c7e918c6c5049cd982e4c8640b18e/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/cd3b3ca72de89aa96a5bee33b0a627cd7501db9051ef2384729f17624a0f0621/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/dde44b704ca8b52479bb05f6c25a7896c615208097c752e75c00f38642d0522b/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f55040730f2aee6c2f43802dc1b3c6ac0dd51388b2c5b9661af838c2ad18931a/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/3b56e8a0a085a9aa2d47c664e8be96d2f324a3cfe3f752d39dc03ee358762263/merged 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:01.078 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:01.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:01.079 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-19T09:01:01.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:2024-09-19T09:01:01.130+0000 7f69dc388480 -1 init, newargv = 0x560d6896dab0 newargc=15 2024-09-19T09:01:01.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[72940]: starting ceph client 2024-09-19T09:01:01.136 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[72940]: starting fuse 2024-09-19T09:01:02.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-19T09:01:02.261 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:01 smithi083 ceph-mon[30926]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:02.267 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:01:02.325 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-19T09:01:02.325 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-19T09:01:02.326 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a94076573254de4ee7877abdca91a9fbcd8633397bc24587600354963a49b78/merged 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b2b9f52c14d141656fa551307d0ddde5b5005d513d8f31f3f2c12e2cf80951e0/merged 2024-09-19T09:01:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/879e9c96c4b0890cc1c6cb240f1d5177aefbd36f3d4013329d6713ec5f41a365/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/68008f9fe1b27ed5a97122982ca3c24a773a950dcb50473c6f338a7c5ca8dceb/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/7bb2bd87d5865fa33e7d4c6c950a06da4371e0a9926ec60b51d75a9a2f5b2fc8/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a35844aba5fe83ed148afdca6b7bb0cbe8c7e918c6c5049cd982e4c8640b18e/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/cd3b3ca72de89aa96a5bee33b0a627cd7501db9051ef2384729f17624a0f0621/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/dde44b704ca8b52479bb05f6c25a7896c615208097c752e75c00f38642d0522b/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f55040730f2aee6c2f43802dc1b3c6ac0dd51388b2c5b9661af838c2ad18931a/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/3b56e8a0a085a9aa2d47c664e8be96d2f324a3cfe3f752d39dc03ee358762263/merged 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:01:02.328 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:02.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:02.329 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi083.stdout:120 2024-09-19T09:01:02.383 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T09:01:02.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-09-19T09:01:02.384 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.admin")) 2024-09-19T09:01:02.385 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-09-19T09:01:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:01 smithi184 ceph-mon[35007]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:01 smithi122 ceph-mon[34247]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:02.506 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.admin.72940.asok 2024-09-19T09:01:02.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:01:02.517 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72940.asok 2024-09-19T09:01:02.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:02.518 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72940.asok status 2024-09-19T09:01:02.651 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "admin", 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "72940", 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:01:02.652 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 14706, 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 14706 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:01:02.653 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1375446045 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1375446045 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.14706 192.168.0.1:0/1375446045", 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/1375446045", 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 17, 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 87, 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-09-19T09:01:02.654 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-09-19T09:01:02.655 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-09-19T09:01:02.655 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:01:02.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:02.660 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-09-19T09:01:02.660 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:02.676 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-09-19T09:01:02.676 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:02.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:02.677 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:02.743 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T09:01:02.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:01:02.856 INFO:teuthology.orchestra.run.smithi083.stdout:# file: . 2024-09-19T09:01:02.856 INFO:teuthology.orchestra.run.smithi083.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T09:01:02.856 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:02.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:01:02.861 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:01:02.862 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:01:02.879 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:01:03.165 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:03.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 -- 172.21.15.83:0/1606510588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa8102da0 msgr2=0x7ffaa8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 --2- 172.21.15.83:0/1606510588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa8102da0 0x7ffaa8103180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009ca0 tx=0x7ffa9802a950 comp rx=0 tx=0).stop 2024-09-19T09:01:03.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 -- 172.21.15.83:0/1606510588 shutdown_connections 2024-09-19T09:01:03.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 --2- 172.21.15.83:0/1606510588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa810c180 0x7ffaa810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 --2- 172.21.15.83:0/1606510588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaa81036c0 0x7ffaa810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 --2- 172.21.15.83:0/1606510588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa8102da0 0x7ffaa8103180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 -- 172.21.15.83:0/1606510588 >> 172.21.15.83:0/1606510588 conn(0x7ffaa80fc7a0 msgr2=0x7ffaa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 -- 172.21.15.83:0/1606510588 shutdown_connections 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.669+0000 7ffaaca70640 1 -- 172.21.15.83:0/1606510588 wait complete. 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 Processor -- start 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 -- start start 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaa8102da0 0x7ffaa8100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa81036c0 0x7ffaa8100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 0x7ffaa8101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8111e50 con 0x7ffaa810c180 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8111cd0 con 0x7ffaa81036c0 2024-09-19T09:01:03.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaaca70640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8111fd0 con 0x7ffaa8102da0 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 0x7ffaa8101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 0x7ffaa8101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43086/0 (socket says 172.21.15.83:43086) 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa6d9d640 1 -- 172.21.15.83:0/2552620002 learned_addr learned my addr 172.21.15.83:0/2552620002 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa5d9b640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa81036c0 0x7ffaa8100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa659c640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaa8102da0 0x7ffaa8100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa6d9d640 1 -- 172.21.15.83:0/2552620002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaa8102da0 msgr2=0x7ffaa8100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.670+0000 7ffaa6d9d640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaa8102da0 0x7ffaa8100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaa6d9d640 1 -- 172.21.15.83:0/2552620002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa81036c0 msgr2=0x7ffaa8100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaa6d9d640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa81036c0 0x7ffaa8100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaa6d9d640 1 -- 172.21.15.83:0/2552620002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa81a6890 con 0x7ffaa810c180 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaa5d9b640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa81036c0 0x7ffaa8100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaa6d9d640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 0x7ffaa8101480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d750 tx=0x7ffaa000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0017070 con 0x7ffaa810c180 2024-09-19T09:01:03.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffaa00054d0 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa81a6b80 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0004c60 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.671+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81a7070 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.672+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa8103180 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.673+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffaa0004e00 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.673+0000 7ffa977fe640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffa900a3240 0x7ffa900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.674+0000 7ffaa659c640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffa900a3240 0x7ffa900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.674+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7ffaa00cf660 con 0x7ffaa810c180 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.674+0000 7ffaa659c640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffa900a3240 0x7ffa900a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa98005fc0 tx=0x7ffa98009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:03.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.678+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffaa009c0a0 con 0x7ffaa810c180 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.856+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffaa8107200 con 0x7ffaa810c180 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.857+0000 7ffa977fe640 1 -- 172.21.15.83:0/2552620002 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+592 (secure 0 0 0) 0x7ffaa009b9a0 con 0x7ffaa810c180 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1998970001 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3215219814 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4071352347 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4197257925 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:03.857 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4167999844 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:03.858 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3719562585 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:03.858 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:03.858 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:03.858 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:03.858 INFO:teuthology.orchestra.run.smithi083.stderr:listed 10 entries 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffa900a3240 msgr2=0x7ffa900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffa900a3240 0x7ffa900a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffa98005fc0 tx=0x7ffa98009360 comp rx=0 tx=0).stop 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 msgr2=0x7ffaa8101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 0x7ffaa8101480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d750 tx=0x7ffaa000dc10 comp rx=0 tx=0).stop 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 shutdown_connections 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffa900a3240 0x7ffa900a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaa810c180 0x7ffaa8101480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaa81036c0 0x7ffaa8100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 --2- 172.21.15.83:0/2552620002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaa8102da0 0x7ffaa8100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 >> 172.21.15.83:0/2552620002 conn(0x7ffaa80fc7a0 msgr2=0x7ffaa80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:03.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 shutdown_connections 2024-09-19T09:01:03.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:03.859+0000 7ffaaca70640 1 -- 172.21.15.83:0/2552620002 wait complete. 2024-09-19T09:01:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:03 smithi083 ceph-mon[30926]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:03 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2552620002' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:01:04.294 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:03 smithi184 ceph-mon[35007]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:04.294 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:03 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2552620002' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:01:04.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:03 smithi122 ceph-mon[34247]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:03 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2552620002' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:01:04.656 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:01:04.656 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:01:04.674 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:01:04.958 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 -- 172.21.15.83:0/4247145796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c0105120 msgr2=0x7f91c010cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4247145796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c0105120 0x7f91c010cca0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c840 tx=0x7f91b802ae10 comp rx=0 tx=0).stop 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 -- 172.21.15.83:0/4247145796 shutdown_connections 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4247145796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c0105120 0x7f91c010cca0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4247145796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91c01009a0 0x7f91c01049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4247145796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 0x7f91c01003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 -- 172.21.15.83:0/4247145796 >> 172.21.15.83:0/4247145796 conn(0x7f91c00fba90 msgr2=0x7f91c00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 -- 172.21.15.83:0/4247145796 shutdown_connections 2024-09-19T09:01:05.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.401+0000 7f91c6c98640 1 -- 172.21.15.83:0/4247145796 wait complete. 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 Processor -- start 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 -- start start 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 0x7f91c01a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 0x7f91c01a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91c0105120 0x7f91c019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010fc30 con 0x7f91c01009a0 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010fab0 con 0x7f91c0105120 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91c6c98640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f91c010fdb0 con 0x7f91c00ffff0 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91bffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 0x7f91c01a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91bffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 0x7f91c01a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43100/0 (socket says 172.21.15.83:43100) 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.402+0000 7f91bffff640 1 -- 172.21.15.83:0/4063592609 learned_addr learned my addr 172.21.15.83:0/4063592609 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91c5235640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91c0105120 0x7f91c019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91c4a34640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 0x7f91c01a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bffff640 1 -- 172.21.15.83:0/4063592609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 msgr2=0x7f91c01a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:05.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bffff640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 0x7f91c01a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bffff640 1 -- 172.21.15.83:0/4063592609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91c0105120 msgr2=0x7f91c019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bffff640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91c0105120 0x7f91c019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bffff640 1 -- 172.21.15.83:0/4063592609 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c019ef90 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91c4a34640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 0x7f91c01a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bffff640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 0x7f91c01a4bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b4a0 tx=0x7f91ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac014070 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91ac010ac0 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c019f280 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac017c30 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.403+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c01ab4d0 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.405+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c01014d0 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.405+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f91ac017070 con 0x7f91c01009a0 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.406+0000 7f91bdffb640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f91b00a3240 0x7f91b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:05.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.406+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f91ac0cf2c0 con 0x7f91c01009a0 2024-09-19T09:01:05.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.406+0000 7f91c4a34640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f91b00a3240 0x7f91b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:05.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.407+0000 7f91c4a34640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f91b00a3240 0x7f91b00a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009930 tx=0x7f91b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:05.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.410+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91ac09bd00 con 0x7f91c01009a0 2024-09-19T09:01:05.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.587+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91c0108300 con 0x7f91c01009a0 2024-09-19T09:01:05.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.587+0000 7f91bdffb640 1 -- 172.21.15.83:0/4063592609 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+592 (secure 0 0 0) 0x7f91ac09b600 con 0x7f91c01009a0 2024-09-19T09:01:05.588 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1998970001 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:05.588 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:05.588 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3215219814 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:05.588 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4071352347 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:05.589 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4197257925 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:05.589 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4167999844 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:05.589 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3719562585 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:05.589 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:01:05.589 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:05.589 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:01:05.590 INFO:teuthology.orchestra.run.smithi083.stderr:listed 10 entries 2024-09-19T09:01:05.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f91b00a3240 msgr2=0x7f91b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f91b00a3240 0x7f91b00a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009930 tx=0x7f91b4008040 comp rx=0 tx=0).stop 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 msgr2=0x7f91c01a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 0x7f91c01a4bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b4a0 tx=0x7f91ac00b960 comp rx=0 tx=0).stop 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 shutdown_connections 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f91b00a3240 0x7f91b00a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91c0105120 0x7f91c019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91c01009a0 0x7f91c01a4bb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 --2- 172.21.15.83:0/4063592609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91c00ffff0 0x7f91c01a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:05.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 >> 172.21.15.83:0/4063592609 conn(0x7f91c00fba90 msgr2=0x7f91c00fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:05.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 shutdown_connections 2024-09-19T09:01:05.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:05.589+0000 7f91c6c98640 1 -- 172.21.15.83:0/4063592609 wait complete. 2024-09-19T09:01:06.373 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:05 smithi083 ceph-mon[30926]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:06.373 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:05 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4063592609' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:01:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:05 smithi184 ceph-mon[35007]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:05 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4063592609' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:01:06.402 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-09-19T09:01:06.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:06.402 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T09:01:06.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[72940]: fuse finished with error 0 and tester_r 0 2024-09-19T09:01:06.431 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:01:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:05 smithi122 ceph-mon[34247]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:05 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4063592609' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:01:06.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:01:06.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:01:06.518 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T09:01:06.553 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:01:06.837 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 -- 172.21.15.83:0/371818007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300101de0 msgr2=0x7f83001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 --2- 172.21.15.83:0/371818007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300101de0 0x7f83001021c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009900 tx=0x7f82fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 -- 172.21.15.83:0/371818007 shutdown_connections 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 --2- 172.21.15.83:0/371818007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8300106f10 0x7f830010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 --2- 172.21.15.83:0/371818007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300102790 0x7f83001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 --2- 172.21.15.83:0/371818007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300101de0 0x7f83001021c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 -- 172.21.15.83:0/371818007 >> 172.21.15.83:0/371818007 conn(0x7f83000fd8c0 msgr2=0x7f83000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 -- 172.21.15.83:0/371818007 shutdown_connections 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.339+0000 7f8307e0a640 1 -- 172.21.15.83:0/371818007 wait complete. 2024-09-19T09:01:07.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 Processor -- start 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 -- start start 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300101de0 0x7f83000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 0x7f8300074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8300106f10 0x7f8300074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8300111de0 con 0x7f8300102790 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8300111c60 con 0x7f8300106f10 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8307e0a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8300111f60 con 0x7f8300101de0 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 0x7f8300074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 0x7f8300074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43126/0 (socket says 172.21.15.83:43126) 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 -- 172.21.15.83:0/2575098132 learned_addr learned my addr 172.21.15.83:0/2575098132 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83063a7640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8300106f10 0x7f8300074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8305ba6640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300101de0 0x7f83000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:07.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 -- 172.21.15.83:0/2575098132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300101de0 msgr2=0x7f83000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300101de0 0x7f83000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 -- 172.21.15.83:0/2575098132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8300106f10 msgr2=0x7f8300074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8300106f10 0x7f8300074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f83053a5640 1 -- 172.21.15.83:0/2575098132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83001aad70 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.340+0000 7f8305ba6640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300101de0 0x7f83000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.341+0000 7f83053a5640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 0x7f8300074a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f82f000c920 tx=0x7f82f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.341+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0007c70 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.341+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82f0007e10 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.341+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83001aafa0 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.341+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0018820 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.341+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83001ab450 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.342+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83001021c0 con 0x7f8300102790 2024-09-19T09:01:07.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.343+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f82f00189c0 con 0x7f8300102790 2024-09-19T09:01:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.343+0000 7f82f6ffd640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82ec0a3240 0x7f82ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.344+0000 7f8305ba6640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82ec0a3240 0x7f82ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.344+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f82f00cfd20 con 0x7f8300102790 2024-09-19T09:01:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.344+0000 7f8305ba6640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82ec0a3240 0x7f82ec0a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f82fc031440 tx=0x7f82fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:07.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.348+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82f0014030 con 0x7f8300102790 2024-09-19T09:01:07.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.515+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f830010a0f0 con 0x7f8300102790 2024-09-19T09:01:07.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.517+0000 7f82f6ffd640 1 -- 172.21.15.83:0/2575098132 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7f82f009c760 con 0x7f8300102790 2024-09-19T09:01:07.517 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:07.518 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:01:07.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82ec0a3240 msgr2=0x7f82ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82ec0a3240 0x7f82ec0a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f82fc031440 tx=0x7f82fc005a20 comp rx=0 tx=0).stop 2024-09-19T09:01:07.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 msgr2=0x7f8300074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 0x7f8300074a30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f82f000c920 tx=0x7f82f000cde0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 shutdown_connections 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82ec0a3240 0x7f82ec0a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8300106f10 0x7f8300074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8300102790 0x7f8300074a30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 --2- 172.21.15.83:0/2575098132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8300101de0 0x7f83000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 >> 172.21.15.83:0/2575098132 conn(0x7f83000fd8c0 msgr2=0x7f83000fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 shutdown_connections 2024-09-19T09:01:07.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:07.519+0000 7f8307e0a640 1 -- 172.21.15.83:0/2575098132 wait complete. 2024-09-19T09:01:08.181 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:07 smithi083 ceph-mon[30926]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:01:08.181 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:07 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2575098132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:08.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:01:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:07 smithi184 ceph-mon[35007]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:01:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2575098132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:08.454 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:08.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:07 smithi122 ceph-mon[34247]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:01:08.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2575098132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 -- 172.21.15.83:0/2014200975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28106f50 msgr2=0x7fda2810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/2014200975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28106f50 0x7fda2810eaf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda20009cd0 tx=0x7fda2002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 -- 172.21.15.83:0/2014200975 shutdown_connections 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/2014200975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28106f50 0x7fda2810eaf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/2014200975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda28100ca0 0x7fda28106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/2014200975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda281002f0 0x7fda281006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 -- 172.21.15.83:0/2014200975 >> 172.21.15.83:0/2014200975 conn(0x7fda28077210 msgr2=0x7fda280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 -- 172.21.15.83:0/2014200975 shutdown_connections 2024-09-19T09:01:08.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.940+0000 7fda2d5bd640 1 -- 172.21.15.83:0/2014200975 wait complete. 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 Processor -- start 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 -- start start 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda281002f0 0x7fda281983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 0x7fda281988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda28106f50 0x7fda2819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fda28111e50 con 0x7fda28100ca0 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda28111cd0 con 0x7fda28106f50 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda2d5bd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fda28111fd0 con 0x7fda281002f0 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 0x7fda281988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 0x7fda281988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43148/0 (socket says 172.21.15.83:43148) 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 -- 172.21.15.83:0/3035702432 learned_addr learned my addr 172.21.15.83:0/3035702432 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:08.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda277fe640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda28106f50 0x7fda2819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda26ffd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda281002f0 0x7fda281983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 -- 172.21.15.83:0/3035702432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda281002f0 msgr2=0x7fda281983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda281002f0 0x7fda281983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 -- 172.21.15.83:0/3035702432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda28106f50 msgr2=0x7fda2819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda28106f50 0x7fda2819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.941+0000 7fda267fc640 1 -- 172.21.15.83:0/3035702432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2819d350 con 0x7fda28100ca0 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.942+0000 7fda267fc640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 0x7fda281988e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda18005fd0 tx=0x7fda1800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.942+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18017070 con 0x7fda28100ca0 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.942+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2819d640 con 0x7fda28100ca0 2024-09-19T09:01:08.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.942+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda18009c30 con 0x7fda28100ca0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.942+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18003d40 con 0x7fda28100ca0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.942+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda281a4f20 con 0x7fda28100ca0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.943+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda281006d0 con 0x7fda28100ca0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.944+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fda18003ee0 con 0x7fda28100ca0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.945+0000 7fda1ffff640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fda140a32c0 0x7fda140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.945+0000 7fda26ffd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fda140a32c0 0x7fda140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.945+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fda180cff50 con 0x7fda28100ca0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.945+0000 7fda26ffd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fda140a32c0 0x7fda140a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda100058c0 tx=0x7fda10005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:08.948+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda18020030 con 0x7fda28100ca0 2024-09-19T09:01:09.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.119+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda28109bb0 con 0x7fda28100ca0 2024-09-19T09:01:09.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.121+0000 7fda1ffff640 1 -- 172.21.15.83:0/3035702432 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7fda1809ca10 con 0x7fda28100ca0 2024-09-19T09:01:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:09.121 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:01:09.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fda140a32c0 msgr2=0x7fda140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:09.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fda140a32c0 0x7fda140a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda100058c0 tx=0x7fda10005c60 comp rx=0 tx=0).stop 2024-09-19T09:01:09.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 msgr2=0x7fda281988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 0x7fda281988e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda18005fd0 tx=0x7fda1800dde0 comp rx=0 tx=0).stop 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 shutdown_connections 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fda140a32c0 0x7fda140a5780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda28106f50 0x7fda2819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda28100ca0 0x7fda281988e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 --2- 172.21.15.83:0/3035702432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda281002f0 0x7fda281983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 >> 172.21.15.83:0/3035702432 conn(0x7fda28077210 msgr2=0x7fda28105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.123+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 shutdown_connections 2024-09-19T09:01:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:09.124+0000 7fda2d5bd640 1 -- 172.21.15.83:0/3035702432 wait complete. 2024-09-19T09:01:09.929 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:01:10.174 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:09 smithi083 ceph-mon[30926]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:01:10.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:09 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3035702432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:09 smithi184 ceph-mon[35007]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:01:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:09 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3035702432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:09 smithi122 ceph-mon[34247]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:01:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:09 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3035702432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:10.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 -- 172.21.15.83:0/1190669012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4908101df0 msgr2=0x7f49081021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:10.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 --2- 172.21.15.83:0/1190669012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4908101df0 0x7f49081021d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009900 tx=0x7f48f802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:10.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 -- 172.21.15.83:0/1190669012 shutdown_connections 2024-09-19T09:01:10.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 --2- 172.21.15.83:0/1190669012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4908106f20 0x7f490810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:10.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 --2- 172.21.15.83:0/1190669012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49081027a0 0x7f49081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:10.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 --2- 172.21.15.83:0/1190669012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4908101df0 0x7f49081021d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 -- 172.21.15.83:0/1190669012 >> 172.21.15.83:0/1190669012 conn(0x7f49080fd8f0 msgr2=0x7f49080ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 -- 172.21.15.83:0/1190669012 shutdown_connections 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.700+0000 7f490ed3e640 1 -- 172.21.15.83:0/1190669012 wait complete. 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 Processor -- start 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 -- start start 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4908101df0 0x7f49080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 0x7f4908074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4908106f20 0x7f4908074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4908111e30 con 0x7f49081027a0 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4908111cb0 con 0x7f4908101df0 2024-09-19T09:01:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490ed3e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4908111fb0 con 0x7f4908106f20 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 0x7f4908074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 0x7f4908074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46186/0 (socket says 172.21.15.83:46186) 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 -- 172.21.15.83:0/3997384852 learned_addr learned my addr 172.21.15.83:0/3997384852 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490cada640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4908101df0 0x7f49080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f490d2db640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4908106f20 0x7f4908074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 -- 172.21.15.83:0/3997384852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4908106f20 msgr2=0x7f4908074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4908106f20 0x7f4908074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 -- 172.21.15.83:0/3997384852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4908101df0 msgr2=0x7f49080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.701+0000 7f4907fff640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4908101df0 0x7f49080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f4907fff640 1 -- 172.21.15.83:0/3997384852 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49081a6830 con 0x7f49081027a0 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f4907fff640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 0x7f4908074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00c970 tx=0x7f48fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc007bb0 con 0x7f49081027a0 2024-09-19T09:01:10.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49081a6b20 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48fc007d50 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00f450 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.702+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49081a7060 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.703+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49081021d0 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.704+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f48fc004f20 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.705+0000 7f4905ffb640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f48f00a3240 0x7f48f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.705+0000 7f490cada640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f48f00a3240 0x7f48f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.705+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f48fc0cfa70 con 0x7f49081027a0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.705+0000 7f490cada640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f48f00a3240 0x7f48f00a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f48f8031440 tx=0x7f48f80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:10.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.709+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48fc014030 con 0x7f49081027a0 2024-09-19T09:01:10.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.912+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4908109b70 con 0x7f49081027a0 2024-09-19T09:01:10.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:10.997+0000 7f4905ffb640 1 -- 172.21.15.83:0/3997384852 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f48fc09c470 con 0x7f49081027a0 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f48f00a3240 msgr2=0x7f48f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f48f00a3240 0x7f48f00a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f48f8031440 tx=0x7f48f80095f0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 msgr2=0x7f4908074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 0x7f4908074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00c970 tx=0x7f48fc00ce30 comp rx=0 tx=0).stop 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 shutdown_connections 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f48f00a3240 0x7f48f00a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4908106f20 0x7f4908074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49081027a0 0x7f4908074a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 --2- 172.21.15.83:0/3997384852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4908101df0 0x7f49080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 >> 172.21.15.83:0/3997384852 conn(0x7f49080fd8f0 msgr2=0x7f49080fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 shutdown_connections 2024-09-19T09:01:11.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:11.000+0000 7f490ed3e640 1 -- 172.21.15.83:0/3997384852 wait complete. 2024-09-19T09:01:11.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:10 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3997384852' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:01:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:10 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3997384852' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:01:11.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:10 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3997384852' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:01:11.839 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T09:01:11.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T09:01:12.088 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:12.208 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:11 smithi083 ceph-mon[30926]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T09:01:12.208 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:11 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3997384852' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:01:12.208 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:11 smithi083 ceph-mon[30926]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:01:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:12 smithi184 ceph-mon[35007]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T09:01:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:12 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3997384852' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:01:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:12 smithi184 ceph-mon[35007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:01:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:12 smithi122 ceph-mon[34247]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T09:01:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:12 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3997384852' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:01:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:12 smithi122 ceph-mon[34247]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:01:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 -- 172.21.15.83:0/2368165765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 msgr2=0x7f2314103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 --2- 172.21.15.83:0/2368165765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314103110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f230c009cd0 tx=0x7f230c02a910 comp rx=0 tx=0).stop 2024-09-19T09:01:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 -- 172.21.15.83:0/2368165765 shutdown_connections 2024-09-19T09:01:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 --2- 172.21.15.83:0/2368165765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23141082a0 0x7f231410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 --2- 172.21.15.83:0/2368165765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23141036e0 0x7f2314107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 --2- 172.21.15.83:0/2368165765 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314103110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 -- 172.21.15.83:0/2368165765 >> 172.21.15.83:0/2368165765 conn(0x7f23140fc7d0 msgr2=0x7f23140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 -- 172.21.15.83:0/2368165765 shutdown_connections 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.553+0000 7f23192b0640 1 -- 172.21.15.83:0/2368165765 wait complete. 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.554+0000 7f23192b0640 1 Processor -- start 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.554+0000 7f23192b0640 1 -- start start 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.554+0000 7f23192b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23141036e0 0x7f2314198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23141082a0 0x7f231419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2314111f90 con 0x7f2314102d30 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2314111e10 con 0x7f23141082a0 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2314112110 con 0x7f23141036e0 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46206/0 (socket says 172.21.15.83:46206) 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 -- 172.21.15.83:0/1304073137 learned_addr learned my addr 172.21.15.83:0/1304073137 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23127fc640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23141036e0 0x7f2314198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23137fe640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23141082a0 0x7f231419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 -- 172.21.15.83:0/1304073137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23141036e0 msgr2=0x7f2314198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23141036e0 0x7f2314198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 -- 172.21.15.83:0/1304073137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23141082a0 msgr2=0x7f231419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23141082a0 0x7f231419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 -- 172.21.15.83:0/1304073137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231419d500 con 0x7f2314102d30 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f2312ffd640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314198550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f230c006010 tx=0x7f230c033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c003cf0 con 0x7f2314102d30 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f230c0044f0 con 0x7f2314102d30 2024-09-19T09:01:12.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231419d790 con 0x7f2314102d30 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c030be0 con 0x7f2314102d30 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.555+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23141a50d0 con 0x7f2314102d30 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.556+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2314103110 con 0x7f2314102d30 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.557+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f230c004040 con 0x7f2314102d30 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.558+0000 7f230bfff640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f23000a3240 0x7f23000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.558+0000 7f23127fc640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f23000a3240 0x7f23000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.558+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f230c0f1360 con 0x7f2314102d30 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.559+0000 7f23127fc640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f23000a3240 0x7f23000a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23140fee80 tx=0x7f22fc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.562+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f230c0bdd60 con 0x7f2314102d30 2024-09-19T09:01:12.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:12.764+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f231410a2b0 con 0x7f2314102d30 2024-09-19T09:01:13.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.005+0000 7f230bfff640 1 -- 172.21.15.83:0/1304073137 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f230c039e10 con 0x7f2314102d30 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f23000a3240 msgr2=0x7f23000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f23000a3240 0x7f23000a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23140fee80 tx=0x7f22fc008040 comp rx=0 tx=0).stop 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 msgr2=0x7f2314198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314198550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f230c006010 tx=0x7f230c033000 comp rx=0 tx=0).stop 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 shutdown_connections 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f23000a3240 0x7f23000a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23141082a0 0x7f231419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23141036e0 0x7f2314198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 --2- 172.21.15.83:0/1304073137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2314102d30 0x7f2314198550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 >> 172.21.15.83:0/1304073137 conn(0x7f23140fc7d0 msgr2=0x7f2314105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 shutdown_connections 2024-09-19T09:01:13.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:13.008+0000 7f23192b0640 1 -- 172.21.15.83:0/1304073137 wait complete. 2024-09-19T09:01:13.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:13 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1304073137' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:01:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:13 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1304073137' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:01:13.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:13 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1304073137' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:01:13.855 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:01:14.107 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T09:01:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:01:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1304073137' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:01:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:01:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:01:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:01:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:14 smithi083 ceph-mon[30926]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:01:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T09:01:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:01:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1304073137' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:01:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:01:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:01:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:01:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:14 smithi184 ceph-mon[35007]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:01:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T09:01:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:01:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1304073137' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:01:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:01:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:01:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:01:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:14 smithi122 ceph-mon[34247]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 -- 172.21.15.83:0/3979462137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8101420 msgr2=0x7f27f810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 --2- 172.21.15.83:0/3979462137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8101420 0x7f27f810d950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009cd0 tx=0x7f27f002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 -- 172.21.15.83:0/3979462137 shutdown_connections 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 --2- 172.21.15.83:0/3979462137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8101420 0x7f27f810d950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 --2- 172.21.15.83:0/3979462137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8100a80 0x7f27f8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 --2- 172.21.15.83:0/3979462137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27f8106a80 0x7f27f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 -- 172.21.15.83:0/3979462137 >> 172.21.15.83:0/3979462137 conn(0x7f27f80fc7a0 msgr2=0x7f27f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 -- 172.21.15.83:0/3979462137 shutdown_connections 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.575+0000 7f27fca46640 1 -- 172.21.15.83:0/3979462137 wait complete. 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 Processor -- start 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 -- start start 2024-09-19T09:01:14.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 0x7f27f8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27f8101420 0x7f27f8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8106a80 0x7f27f819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f27f8110d50 con 0x7f27f8100a80 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27f8110bd0 con 0x7f27f8101420 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27fca46640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27f8110ed0 con 0x7f27f8106a80 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 0x7f27f8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 0x7f27f8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46220/0 (socket says 172.21.15.83:46220) 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 -- 172.21.15.83:0/2460968766 learned_addr learned my addr 172.21.15.83:0/2460968766 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f6d9d640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8106a80 0x7f27f819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f5d9b640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27f8101420 0x7f27f8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 -- 172.21.15.83:0/2460968766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8106a80 msgr2=0x7f27f819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8106a80 0x7f27f819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 -- 172.21.15.83:0/2460968766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27f8101420 msgr2=0x7f27f8198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27f8101420 0x7f27f8198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 -- 172.21.15.83:0/2460968766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f819d2e0 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f6d9d640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8106a80 0x7f27f819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.576+0000 7f27f659c640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 0x7f27f8198330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c890 tx=0x7f27e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.577+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8004220 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.577+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27e80043c0 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.577+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f819d5d0 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.577+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8004a00 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.577+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f81a4eb0 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.578+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f8100ee0 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.579+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f27e8004ba0 con 0x7f27f8100a80 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.579+0000 7f27e77fe640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27e00a3240 0x7f27e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.579+0000 7f27f5d9b640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27e00a3240 0x7f27e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.579+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f27e80cf960 con 0x7f27f8100a80 2024-09-19T09:01:14.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.580+0000 7f27f5d9b640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27e00a3240 0x7f27e00a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27f81051a0 tx=0x7f27ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:14.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.584+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27e8014030 con 0x7f27f8100a80 2024-09-19T09:01:14.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:14.787+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f27f810a050 con 0x7f27f8100a80 2024-09-19T09:01:15.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.017+0000 7f27e77fe640 1 -- 172.21.15.83:0/2460968766 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f27e809c3a0 con 0x7f27f8100a80 2024-09-19T09:01:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27e00a3240 msgr2=0x7f27e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27e00a3240 0x7f27e00a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27f81051a0 tx=0x7f27ec008040 comp rx=0 tx=0).stop 2024-09-19T09:01:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 msgr2=0x7f27f8198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 0x7f27f8198330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c890 tx=0x7f27e800cd50 comp rx=0 tx=0).stop 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 shutdown_connections 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27e00a3240 0x7f27e00a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f8106a80 0x7f27f819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27f8101420 0x7f27f8198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 --2- 172.21.15.83:0/2460968766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27f8100a80 0x7f27f8198330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 >> 172.21.15.83:0/2460968766 conn(0x7f27f80fc7a0 msgr2=0x7f27f806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 shutdown_connections 2024-09-19T09:01:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:15.019+0000 7f27fca46640 1 -- 172.21.15.83:0/2460968766 wait complete. 2024-09-19T09:01:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:15 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] up:active 2024-09-19T09:01:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:15 smithi083 ceph-mon[30926]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:01:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:15 smithi083 ceph-mon[30926]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:01:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:15 smithi083 ceph-mon[30926]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:01:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:15 smithi083 ceph-mon[30926]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:01:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:15 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2460968766' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:01:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:15 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] up:active 2024-09-19T09:01:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:15 smithi184 ceph-mon[35007]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:01:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:15 smithi184 ceph-mon[35007]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:01:15.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:15 smithi184 ceph-mon[35007]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:01:15.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:15 smithi184 ceph-mon[35007]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:01:15.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2460968766' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:01:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:15 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] up:active 2024-09-19T09:01:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:15 smithi122 ceph-mon[34247]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:01:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:15 smithi122 ceph-mon[34247]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:01:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:15 smithi122 ceph-mon[34247]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:01:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:15 smithi122 ceph-mon[34247]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:01:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:15 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2460968766' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:01:15.826 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:01:16.080 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:16.202 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-09-19T09:01:16.202 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2460968766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:01:16.202 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] up:active 2024-09-19T09:01:16.202 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] up:active 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: Cluster is now healthy 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T09:01:16.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:16 smithi083 ceph-mon[30926]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T09:01:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-09-19T09:01:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2460968766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] up:active 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] up:active 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: Cluster is now healthy 2024-09-19T09:01:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T09:01:16.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T09:01:16.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:16 smithi184 ceph-mon[35007]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T09:01:16.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2460968766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] up:active 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] up:active 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: Cluster is now healthy 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T09:01:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:16 smithi122 ceph-mon[34247]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T09:01:16.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 -- 172.21.15.83:0/1738701114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0106f10 msgr2=0x7fc2f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/1738701114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0106f10 0x7fc2f010ea90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009900 tx=0x7fc2e802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:16.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 -- 172.21.15.83:0/1738701114 shutdown_connections 2024-09-19T09:01:16.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/1738701114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0106f10 0x7fc2f010ea90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/1738701114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f0102790 0x7fc2f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/1738701114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2f0101de0 0x7fc2f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 -- 172.21.15.83:0/1738701114 >> 172.21.15.83:0/1738701114 conn(0x7fc2f00fd8c0 msgr2=0x7fc2f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 -- 172.21.15.83:0/1738701114 shutdown_connections 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.574+0000 7fc2f5e53640 1 -- 172.21.15.83:0/1738701114 wait complete. 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 Processor -- start 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 -- start start 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2f0101de0 0x7fc2f019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 0x7fc2f019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f0106f10 0x7fc2f019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0111e40 con 0x7fc2f0102790 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0111cc0 con 0x7fc2f0106f10 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2f5e53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0111fc0 con 0x7fc2f0101de0 2024-09-19T09:01:16.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2eeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 0x7fc2f019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2eeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 0x7fc2f019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46230/0 (socket says 172.21.15.83:46230) 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2eeffd640 1 -- 172.21.15.83:0/2529772742 learned_addr learned my addr 172.21.15.83:0/2529772742 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.575+0000 7fc2effff640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f0106f10 0x7fc2f019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2eeffd640 1 -- 172.21.15.83:0/2529772742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2f0101de0 msgr2=0x7fc2f019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2ef7fe640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2f0101de0 0x7fc2f019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2eeffd640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2f0101de0 0x7fc2f019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2eeffd640 1 -- 172.21.15.83:0/2529772742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f0106f10 msgr2=0x7fc2f019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2eeffd640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f0106f10 0x7fc2f019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2eeffd640 1 -- 172.21.15.83:0/2529772742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f019f530 con 0x7fc2f0102790 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2eeffd640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 0x7fc2f019aac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400eab0 tx=0x7fc2e400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400ce40 con 0x7fc2f0102790 2024-09-19T09:01:16.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2e4011920 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f019f820 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4010a00 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.576+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f01a7100 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.577+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f01021c0 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.578+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc2e4011ad0 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.579+0000 7fc2ecff9640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2d80a3240 0x7fc2d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.579+0000 7fc2ef7fe640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2d80a3240 0x7fc2d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.579+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fc2e40d0230 con 0x7fc2f0102790 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.579+0000 7fc2ef7fe640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2d80a3240 0x7fc2d80a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000a810 tx=0x7fc2e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:16.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.582+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2e4016030 con 0x7fc2f0102790 2024-09-19T09:01:16.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:16.784+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc2f01a7430 con 0x7fc2f0102790 2024-09-19T09:01:17.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.199+0000 7fc2ecff9640 1 -- 172.21.15.83:0/2529772742 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7fc2e40bc070 con 0x7fc2f0102790 2024-09-19T09:01:17.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2d80a3240 msgr2=0x7fc2d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2d80a3240 0x7fc2d80a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000a810 tx=0x7fc2e0008040 comp rx=0 tx=0).stop 2024-09-19T09:01:17.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 msgr2=0x7fc2f019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 0x7fc2f019aac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400eab0 tx=0x7fc2e400ef70 comp rx=0 tx=0).stop 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 shutdown_connections 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2d80a3240 0x7fc2d80a5700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f0106f10 0x7fc2f019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2f0102790 0x7fc2f019aac0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 --2- 172.21.15.83:0/2529772742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2f0101de0 0x7fc2f019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.201+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 >> 172.21.15.83:0/2529772742 conn(0x7fc2f00fd8c0 msgr2=0x7fc2f00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.202+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 shutdown_connections 2024-09-19T09:01:17.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:17.202+0000 7fc2f5e53640 1 -- 172.21.15.83:0/2529772742 wait complete. 2024-09-19T09:01:17.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] up:active 2024-09-19T09:01:17.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-mon[34247]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:01:17.538 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:17.538 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2529772742' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:01:17.538 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-mon[34247]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-19T09:01:17.539 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:17 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] up:active 2024-09-19T09:01:17.539 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:17 smithi083 ceph-mon[30926]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:01:17.539 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:17 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:17.539 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:17 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2529772742' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:01:17.539 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:17 smithi083 ceph-mon[30926]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-19T09:01:17.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:17 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] up:active 2024-09-19T09:01:17.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:17 smithi184 ceph-mon[35007]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:01:17.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:17 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:17.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:17 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2529772742' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:01:17.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:17 smithi184 ceph-mon[35007]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-19T09:01:17.949 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T09:01:17.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:01:18.199 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:18.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:18 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2529772742' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:01:18.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:18 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:18.461 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: 2024-09-19T09:01:17.973+0000 7fbd7b064640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T09:01:18.461 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: 2024-09-19T09:01:17.973+0000 7fbd7b064640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-19T09:01:18.461 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:01:17 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: 2024-09-19T09:01:17.973+0000 7fbd7b064640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T09:01:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2529772742' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:01:18.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:18.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:18 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2529772742' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:01:18.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:18 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:18.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 -- 172.21.15.83:0/3570717382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0102790 msgr2=0x7ff3d01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/3570717382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0102790 0x7ff3d01067e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009900 tx=0x7ff3c002a410 comp rx=0 tx=0).stop 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 -- 172.21.15.83:0/3570717382 shutdown_connections 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/3570717382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3d0106f10 0x7ff3d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/3570717382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0102790 0x7ff3d01067e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/3570717382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d0101de0 0x7ff3d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 -- 172.21.15.83:0/3570717382 >> 172.21.15.83:0/3570717382 conn(0x7ff3d00fd8c0 msgr2=0x7ff3d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 -- 172.21.15.83:0/3570717382 shutdown_connections 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.694+0000 7ff3d84c2640 1 -- 172.21.15.83:0/3570717382 wait complete. 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 Processor -- start 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 -- start start 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 0x7ff3d019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3d0102790 0x7ff3d019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d0106f10 0x7ff3d019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d0111e40 con 0x7ff3d0101de0 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d0111cc0 con 0x7ff3d0102790 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d84c2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d0111fc0 con 0x7ff3d0106f10 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d625e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 0x7ff3d019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d625e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 0x7ff3d019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46244/0 (socket says 172.21.15.83:46244) 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d625e640 1 -- 172.21.15.83:0/1297677736 learned_addr learned my addr 172.21.15.83:0/1297677736 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.695+0000 7ff3d5a5d640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3d0102790 0x7ff3d019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d625e640 1 -- 172.21.15.83:0/1297677736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d0106f10 msgr2=0x7ff3d019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d625e640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d0106f10 0x7ff3d019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d625e640 1 -- 172.21.15.83:0/1297677736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3d0102790 msgr2=0x7ff3d019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d625e640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3d0102790 0x7ff3d019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d625e640 1 -- 172.21.15.83:0/1297677736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d019f630 con 0x7ff3d0101de0 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d625e640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 0x7ff3d019a680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00b4a0 tx=0x7ff3cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc014070 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3cc010ac0 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc017c30 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d019f920 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.696+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d01a7200 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.697+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d01021c0 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.698+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff3cc017070 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.699+0000 7ff3c77fe640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff3bc0a32c0 0x7ff3bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.699+0000 7ff3d5a5d640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff3bc0a32c0 0x7ff3bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.699+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7ff3cc0ceff0 con 0x7ff3d0101de0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.699+0000 7ff3d5a5d640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff3bc0a32c0 0x7ff3bc0a5780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0031440 tx=0x7ff3c00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.703+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3cc09ba30 con 0x7ff3d0101de0 2024-09-19T09:01:18.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.896+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff3d010de00 con 0x7ff3bc0a32c0 2024-09-19T09:01:18.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.922+0000 7ff3c77fe640 1 -- 172.21.15.83:0/1297677736 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3d010de00 con 0x7ff3bc0a32c0 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff3bc0a32c0 msgr2=0x7ff3bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff3bc0a32c0 0x7ff3bc0a5780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0031440 tx=0x7ff3c00095f0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 msgr2=0x7ff3d019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 0x7ff3d019a680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00b4a0 tx=0x7ff3cc00b960 comp rx=0 tx=0).stop 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 shutdown_connections 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff3bc0a32c0 0x7ff3bc0a5780 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d0106f10 0x7ff3d019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3d0102790 0x7ff3d019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 --2- 172.21.15.83:0/1297677736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d0101de0 0x7ff3d019a680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 >> 172.21.15.83:0/1297677736 conn(0x7ff3d00fd8c0 msgr2=0x7ff3d00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 shutdown_connections 2024-09-19T09:01:18.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:18.925+0000 7ff3d84c2640 1 -- 172.21.15.83:0/1297677736 wait complete. 2024-09-19T09:01:19.206 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:01:18.901+0000 7f5e7b3c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:01:19.207 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:01:18.901+0000 7f5e7b3c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:01:19.207 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:01:18.901+0000 7f5e7b3c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:01:19.207 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:01:18.901+0000 7f5e7b3c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:01:19.207 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:01:18 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:01:18.901+0000 7f5e7b3c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:01:19.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:19 smithi122 ceph-mon[34247]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:19 smithi122 ceph-mon[34247]: pgmap v305: 129 pgs: 129 active+clean; 585 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-09-19T09:01:19.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:19 smithi083 ceph-mon[30926]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:19.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:19 smithi083 ceph-mon[30926]: pgmap v305: 129 pgs: 129 active+clean; 585 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-09-19T09:01:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:19 smithi184 ceph-mon[35007]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:19 smithi184 ceph-mon[35007]: pgmap v305: 129 pgs: 129 active+clean; 585 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-09-19T09:01:19.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:01:19.993 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:20.423 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:20 smithi083 ceph-mon[30926]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:01:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:20 smithi122 ceph-mon[34247]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:01:20.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 -- 172.21.15.83:0/2389373341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c102ef0 msgr2=0x7fc88c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 --2- 172.21.15.83:0/2389373341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c102ef0 0x7fc88c10da40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc884009ca0 tx=0x7fc88402a950 comp rx=0 tx=0).stop 2024-09-19T09:01:20.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 -- 172.21.15.83:0/2389373341 shutdown_connections 2024-09-19T09:01:20.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 --2- 172.21.15.83:0/2389373341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c102ef0 0x7fc88c10da40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 --2- 172.21.15.83:0/2389373341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc88c102570 0x7fc88c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 --2- 172.21.15.83:0/2389373341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c100e20 0x7fc88c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 -- 172.21.15.83:0/2389373341 >> 172.21.15.83:0/2389373341 conn(0x7fc88c0fc7d0 msgr2=0x7fc88c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 -- 172.21.15.83:0/2389373341 shutdown_connections 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 -- 172.21.15.83:0/2389373341 wait complete. 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 Processor -- start 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.509+0000 7fc892c1e640 1 -- start start 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 0x7fc88c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc88c102570 0x7fc88c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c102ef0 0x7fc88c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c110f20 con 0x7fc88c100e20 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c110da0 con 0x7fc88c102570 2024-09-19T09:01:20.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1110a0 con 0x7fc88c102ef0 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 0x7fc88c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 0x7fc88c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49860/0 (socket says 172.21.15.83:49860) 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 -- 172.21.15.83:0/3376088347 learned_addr learned my addr 172.21.15.83:0/3376088347 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8911bb640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c102ef0 0x7fc88c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 -- 172.21.15.83:0/3376088347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c102ef0 msgr2=0x7fc88c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c102ef0 0x7fc88c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 -- 172.21.15.83:0/3376088347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc88c102570 msgr2=0x7fc88c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc88c102570 0x7fc88c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 -- 172.21.15.83:0/3376088347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c19d500 con 0x7fc88c100e20 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8911bb640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c102ef0 0x7fc88c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc8909ba640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 0x7fc88c198550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc88000b4a0 tx=0x7fc88000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880014070 con 0x7fc88c100e20 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c19d7f0 con 0x7fc88c100e20 2024-09-19T09:01:20.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc880010ac0 con 0x7fc88c100e20 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.510+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880017c30 con 0x7fc88c100e20 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.511+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c1a50d0 con 0x7fc88c100e20 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.512+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c101280 con 0x7fc88c100e20 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.512+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc880017070 con 0x7fc88c100e20 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.513+0000 7fc889ffb640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc87c0a32d0 0x7fc87c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.513+0000 7fc88bfff640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc87c0a32d0 0x7fc87c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.513+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fc8800cf400 con 0x7fc88c100e20 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.513+0000 7fc88bfff640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc87c0a32d0 0x7fc87c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0ff0e0 tx=0x7fc878006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:20.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.517+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc88009bdf0 con 0x7fc88c100e20 2024-09-19T09:01:20.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:20 smithi184 ceph-mon[35007]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:01:20.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.706+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc88c062630 con 0x7fc87c0a32d0 2024-09-19T09:01:20.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.730+0000 7fc889ffb640 1 -- 172.21.15.83:0/3376088347 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc88c062630 con 0x7fc87c0a32d0 2024-09-19T09:01:20.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc87c0a32d0 msgr2=0x7fc87c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc87c0a32d0 0x7fc87c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0ff0e0 tx=0x7fc878006c90 comp rx=0 tx=0).stop 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 msgr2=0x7fc88c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 0x7fc88c198550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc88000b4a0 tx=0x7fc88000b960 comp rx=0 tx=0).stop 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 shutdown_connections 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc87c0a32d0 0x7fc87c0a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc88c102ef0 0x7fc88c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc88c102570 0x7fc88c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 --2- 172.21.15.83:0/3376088347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc88c100e20 0x7fc88c198550 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.732+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 >> 172.21.15.83:0/3376088347 conn(0x7fc88c0fc7d0 msgr2=0x7fc88c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.733+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 shutdown_connections 2024-09-19T09:01:20.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:20.733+0000 7fc892c1e640 1 -- 172.21.15.83:0/3376088347 wait complete. 2024-09-19T09:01:21.406 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:21 smithi083 ceph-mon[30926]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:21.406 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:21 smithi083 ceph-mon[30926]: pgmap v306: 129 pgs: 129 active+clean; 593 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-19T09:01:21.433 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:01:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:21 smithi184 ceph-mon[35007]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:21 smithi184 ceph-mon[35007]: pgmap v306: 129 pgs: 129 active+clean; 593 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-19T09:01:21.680 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:21.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:21 smithi122 ceph-mon[34247]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:21.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:21 smithi122 ceph-mon[34247]: pgmap v306: 129 pgs: 129 active+clean; 593 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-19T09:01:22.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 -- 172.21.15.83:0/1225146400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc101450 msgr2=0x7f04dc105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:22.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1225146400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc101450 0x7f04dc105920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009900 tx=0x7f04cc02a470 comp rx=0 tx=0).stop 2024-09-19T09:01:22.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 -- 172.21.15.83:0/1225146400 shutdown_connections 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1225146400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc105f40 0x7f04dc1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1225146400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc101450 0x7f04dc105920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1225146400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc100b30 0x7f04dc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.152+0000 7f04e34d5640 1 -- 172.21.15.83:0/1225146400 >> 172.21.15.83:0/1225146400 conn(0x7f04dc0fc7a0 msgr2=0x7f04dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.153+0000 7f04e34d5640 1 -- 172.21.15.83:0/1225146400 shutdown_connections 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.153+0000 7f04e34d5640 1 -- 172.21.15.83:0/1225146400 wait complete. 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.153+0000 7f04e34d5640 1 Processor -- start 2024-09-19T09:01:22.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.153+0000 7f04e34d5640 1 -- start start 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 0x7f04dc1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc101450 0x7f04dc1a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc105f40 0x7f04dc19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc118490 con 0x7f04dc100b30 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc118310 con 0x7f04dc105f40 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc118610 con 0x7f04dc101450 2024-09-19T09:01:22.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 0x7f04dc1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 0x7f04dc1a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49884/0 (socket says 172.21.15.83:49884) 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 -- 172.21.15.83:0/1625346661 learned_addr learned my addr 172.21.15.83:0/1625346661 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1a72640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc105f40 0x7f04dc19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e0a70640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc101450 0x7f04dc1a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 -- 172.21.15.83:0/1625346661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc101450 msgr2=0x7f04dc1a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc101450 0x7f04dc1a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 -- 172.21.15.83:0/1625346661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc105f40 msgr2=0x7f04dc19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:22.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc105f40 0x7f04dc19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 -- 172.21.15.83:0/1625346661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc19efd0 con 0x7f04dc100b30 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e0a70640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc101450 0x7f04dc1a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1a72640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc105f40 0x7f04dc19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e1271640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 0x7f04dc1a46e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f04d800b4a0 tx=0x7f04d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8014070 con 0x7f04dc100b30 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04d8010ac0 con 0x7f04dc100b30 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc19f2c0 con 0x7f04dc100b30 2024-09-19T09:01:22.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8017c30 con 0x7f04dc100b30 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.154+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc1ab5b0 con 0x7f04dc100b30 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.155+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04dc105920 con 0x7f04dc100b30 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.156+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f04d8017070 con 0x7f04dc100b30 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.157+0000 7f04d27fc640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f04c80a32d0 0x7f04c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.157+0000 7f04e0a70640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f04c80a32d0 0x7f04c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.157+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f04d80cf3f0 con 0x7f04dc100b30 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.157+0000 7f04e0a70640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f04c80a32d0 0x7f04c80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f04cc000c00 tx=0x7f04cc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:22.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.161+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04d809bde0 con 0x7f04dc100b30 2024-09-19T09:01:22.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.356+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f04dc10fe10 con 0x7f04c80a32d0 2024-09-19T09:01:22.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.361+0000 7f04d27fc640 1 -- 172.21.15.83:0/1625346661 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f04dc10fe10 con 0x7f04c80a32d0 2024-09-19T09:01:22.361 INFO:teuthology.orchestra.run.smithi083.stdout:/volumes/qa/sv_0/ed5b2424-aa41-4ad3-9952-2bbdaa8a1220 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f04c80a32d0 msgr2=0x7f04c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f04c80a32d0 0x7f04c80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f04cc000c00 tx=0x7f04cc031400 comp rx=0 tx=0).stop 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 msgr2=0x7f04dc1a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 0x7f04dc1a46e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f04d800b4a0 tx=0x7f04d800b960 comp rx=0 tx=0).stop 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 shutdown_connections 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f04c80a32d0 0x7f04c80a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04dc105f40 0x7f04dc19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04dc101450 0x7f04dc1a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 --2- 172.21.15.83:0/1625346661 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04dc100b30 0x7f04dc1a46e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:22.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 >> 172.21.15.83:0/1625346661 conn(0x7f04dc0fc7a0 msgr2=0x7f04dc10f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:22.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 shutdown_connections 2024-09-19T09:01:22.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:22.363+0000 7f04e34d5640 1 -- 172.21.15.83:0/1625346661 wait complete. 2024-09-19T09:01:23.101 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:01:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:23.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 -- 172.21.15.83:0/4017835619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 msgr2=0x7fade01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 --2- 172.21.15.83:0/4017835619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade01029b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009900 tx=0x7fadc802a480 comp rx=0 tx=0).stop 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 -- 172.21.15.83:0/4017835619 shutdown_connections 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 --2- 172.21.15.83:0/4017835619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fade0102ef0 0x7fade010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 --2- 172.21.15.83:0/4017835619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade01029b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 --2- 172.21.15.83:0/4017835619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fade0100e20 0x7fade0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 -- 172.21.15.83:0/4017835619 >> 172.21.15.83:0/4017835619 conn(0x7fade00fc7d0 msgr2=0x7fade00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 -- 172.21.15.83:0/4017835619 shutdown_connections 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.821+0000 7fade49ac640 1 -- 172.21.15.83:0/4017835619 wait complete. 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 Processor -- start 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 -- start start 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fade0100e20 0x7fade00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fade0102ef0 0x7fade00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fade0110e30 con 0x7fade0102570 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fade0110cb0 con 0x7fade0100e20 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fade49ac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fade0110fb0 con 0x7fade0102ef0 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49904/0 (socket says 172.21.15.83:49904) 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 -- 172.21.15.83:0/808169375 learned_addr learned my addr 172.21.15.83:0/808169375 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadde59c640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fade0100e20 0x7fade00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 -- 172.21.15.83:0/808169375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fade0102ef0 msgr2=0x7fade00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fade0102ef0 0x7fade00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 -- 172.21.15.83:0/808169375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fade0100e20 msgr2=0x7fade00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fade0100e20 0x7fade00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 -- 172.21.15.83:0/808169375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade01a6920 con 0x7fade0102570 2024-09-19T09:01:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.822+0000 7fadd7fff640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade00fd1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006010 tx=0x7fadc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.823+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc803f030 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.823+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fadc8003cb0 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.823+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8035070 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.823+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade01a6bb0 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.823+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01a70e0 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.824+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade0101200 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.825+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fadc8042030 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.825+0000 7fadd77fe640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fadcc0a3350 0x7fadcc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.825+0000 7fadde59c640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fadcc0a3350 0x7fadcc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.825+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fadc80f02f0 con 0x7fade0102570 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.826+0000 7fadde59c640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fadcc0a3350 0x7fadcc0a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005fd0 tx=0x7fadd0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:23.830+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fadc80bcb90 con 0x7fade0102570 2024-09-19T09:01:24.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.023+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fade0062630 con 0x7fadcc0a3350 2024-09-19T09:01:24.023 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:23 smithi083 ceph-mon[30926]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:24.024 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:23 smithi083 ceph-mon[30926]: pgmap v307: 129 pgs: 129 active+clean; 594 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.9 KiB/s wr, 21 op/s 2024-09-19T09:01:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.056+0000 7fadd77fe640 1 -- 172.21.15.83:0/808169375 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fade0062630 con 0x7fadcc0a3350 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fadcc0a3350 msgr2=0x7fadcc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fadcc0a3350 0x7fadcc0a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005fd0 tx=0x7fadd0005850 comp rx=0 tx=0).stop 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 msgr2=0x7fade00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade00fd1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006010 tx=0x7fadc80042f0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 shutdown_connections 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fadcc0a3350 0x7fadcc0a5810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fade0102ef0 0x7fade00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fade0102570 0x7fade00fd1c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 --2- 172.21.15.83:0/808169375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fade0100e20 0x7fade00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 >> 172.21.15.83:0/808169375 conn(0x7fade00fc7d0 msgr2=0x7fade006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 shutdown_connections 2024-09-19T09:01:24.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:24.058+0000 7fade49ac640 1 -- 172.21.15.83:0/808169375 wait complete. 2024-09-19T09:01:24.352 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:23 smithi184 ceph-mon[35007]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:24.353 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:23 smithi184 ceph-mon[35007]: pgmap v307: 129 pgs: 129 active+clean; 594 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.9 KiB/s wr, 21 op/s 2024-09-19T09:01:24.414 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:23 smithi122 ceph-mon[34247]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:24.414 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:23 smithi122 ceph-mon[34247]: pgmap v307: 129 pgs: 129 active+clean; 594 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.9 KiB/s wr, 21 op/s 2024-09-19T09:01:24.775 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:01:25.021 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:25.142 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:24 smithi083 ceph-mon[30926]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:25.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:24 smithi184 ceph-mon[35007]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:25.429 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:24 smithi122 ceph-mon[34247]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:25.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 -- 172.21.15.83:0/265812006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102570 msgr2=0x7f3a401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 --2- 172.21.15.83:0/265812006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102570 0x7f3a401029b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009900 tx=0x7f3a2802a480 comp rx=0 tx=0).stop 2024-09-19T09:01:25.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 -- 172.21.15.83:0/265812006 shutdown_connections 2024-09-19T09:01:25.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 --2- 172.21.15.83:0/265812006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a40102ef0 0x7f3a4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 --2- 172.21.15.83:0/265812006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102570 0x7f3a401029b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 --2- 172.21.15.83:0/265812006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a40100e20 0x7f3a40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 -- 172.21.15.83:0/265812006 >> 172.21.15.83:0/265812006 conn(0x7f3a400fc7d0 msgr2=0x7f3a400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 -- 172.21.15.83:0/265812006 shutdown_connections 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.518+0000 7f3a466e7640 1 -- 172.21.15.83:0/265812006 wait complete. 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 Processor -- start 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 -- start start 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a40100e20 0x7f3a401972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a40102570 0x7f3a40197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 0x7f3a4019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40110e30 con 0x7f3a40102ef0 2024-09-19T09:01:25.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40110cb0 con 0x7f3a40102570 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a466e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40110fb0 con 0x7f3a40100e20 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 0x7f3a4019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 0x7f3a4019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49918/0 (socket says 172.21.15.83:49918) 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 -- 172.21.15.83:0/1987984591 learned_addr learned my addr 172.21.15.83:0/1987984591 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a37fff640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a40102570 0x7f3a40197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a3ffff640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a40100e20 0x7f3a401972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 -- 172.21.15.83:0/1987984591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a40100e20 msgr2=0x7f3a401972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a40100e20 0x7f3a401972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 -- 172.21.15.83:0/1987984591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a40102570 msgr2=0x7f3a40197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a40102570 0x7f3a40197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.519+0000 7f3a44c84640 1 -- 172.21.15.83:0/1987984591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4019c280 con 0x7f3a40102ef0 2024-09-19T09:01:25.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.520+0000 7f3a44c84640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 0x7f3a4019bba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800eaa0 tx=0x7f3a3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.520+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800cdb0 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.520+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a38005020 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.520+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a380116d0 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.520+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4019c570 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.520+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a401a3e50 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.521+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a40101200 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.522+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3a380051d0 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.523+0000 7f3a3dffb640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3a2c0a3350 0x7f3a2c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.523+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f3a380cff20 con 0x7f3a40102ef0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.523+0000 7f3a3ffff640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3a2c0a3350 0x7f3a2c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.523+0000 7f3a3ffff640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3a2c0a3350 0x7f3a2c0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3a30005fd0 tx=0x7f3a30005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.527+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a38016030 con 0x7f3a40102ef0 2024-09-19T09:01:25.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.718+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3a40109100 con 0x7f3a2c0a3350 2024-09-19T09:01:25.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.722+0000 7f3a3dffb640 1 -- 172.21.15.83:0/1987984591 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3a3000fb30 con 0x7f3a2c0a3350 2024-09-19T09:01:25.722 INFO:teuthology.orchestra.run.smithi083.stdout:/volumes/qa/sv_1/0e50c84d-98f5-4855-8652-a2874d857089 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3a2c0a3350 msgr2=0x7f3a2c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3a2c0a3350 0x7f3a2c0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3a30005fd0 tx=0x7f3a30005850 comp rx=0 tx=0).stop 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 msgr2=0x7f3a4019bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 0x7f3a4019bba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800eaa0 tx=0x7f3a3800ef60 comp rx=0 tx=0).stop 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 shutdown_connections 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3a2c0a3350 0x7f3a2c0a5810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a40102ef0 0x7f3a4019bba0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a40102570 0x7f3a40197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 --2- 172.21.15.83:0/1987984591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a40100e20 0x7f3a401972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.724+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 >> 172.21.15.83:0/1987984591 conn(0x7f3a400fc7d0 msgr2=0x7f3a400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.725+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 shutdown_connections 2024-09-19T09:01:25.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:25.725+0000 7f3a466e7640 1 -- 172.21.15.83:0/1987984591 wait complete. 2024-09-19T09:01:26.375 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:25 smithi083 ceph-mon[30926]: pgmap v308: 129 pgs: 129 active+clean; 594 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-09-19T09:01:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:25 smithi184 ceph-mon[35007]: pgmap v308: 129 pgs: 129 active+clean; 594 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-09-19T09:01:26.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:26.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:25 smithi122 ceph-mon[34247]: pgmap v308: 129 pgs: 129 active+clean; 594 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.2 KiB/s wr, 22 op/s 2024-09-19T09:01:26.677 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:27.060 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:27 smithi083 ceph-mon[30926]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 -- 172.21.15.83:0/2945150033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f410c170 msgr2=0x7f95f410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 --2- 172.21.15.83:0/2945150033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f410c170 0x7f95f410e610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009900 tx=0x7f95ec02a480 comp rx=0 tx=0).stop 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 -- 172.21.15.83:0/2945150033 shutdown_connections 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 --2- 172.21.15.83:0/2945150033 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f410c170 0x7f95f410e610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 --2- 172.21.15.83:0/2945150033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95f4103660 0x7f95f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 --2- 172.21.15.83:0/2945150033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f4102d40 0x7f95f4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 -- 172.21.15.83:0/2945150033 >> 172.21.15.83:0/2945150033 conn(0x7f95f40fc7a0 msgr2=0x7f95f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 -- 172.21.15.83:0/2945150033 shutdown_connections 2024-09-19T09:01:27.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 -- 172.21.15.83:0/2945150033 wait complete. 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.142+0000 7f95fb899640 1 Processor -- start 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 -- start start 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 0x7f95f41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f4103660 0x7f95f4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95f410c170 0x7f95f4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f95f4111e60 con 0x7f95f4102d40 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95f4111ce0 con 0x7f95f410c170 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95fb899640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f95f4111fe0 con 0x7f95f4103660 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 0x7f95f41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 0x7f95f41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49938/0 (socket says 172.21.15.83:49938) 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 -- 172.21.15.83:0/662370906 learned_addr learned my addr 172.21.15.83:0/662370906 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:27.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9e36640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95f410c170 0x7f95f4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f8e34640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f4103660 0x7f95f4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 -- 172.21.15.83:0/662370906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f4103660 msgr2=0x7f95f4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f4103660 0x7f95f4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 -- 172.21.15.83:0/662370906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95f410c170 msgr2=0x7f95f4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95f410c170 0x7f95f4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 -- 172.21.15.83:0/662370906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f41a6840 con 0x7f95f4102d40 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.143+0000 7f95f9635640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 0x7f95f41009a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95e400b4a0 tx=0x7f95e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.144+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4014070 con 0x7f95f4102d40 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.144+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f41a6b30 con 0x7f95f4102d40 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.144+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95e4010ac0 con 0x7f95f4102d40 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.144+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4017c30 con 0x7f95f4102d40 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.144+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f41a7070 con 0x7f95f4102d40 2024-09-19T09:01:27.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.145+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f4103120 con 0x7f95f4102d40 2024-09-19T09:01:27.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.146+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f95e4017070 con 0x7f95f4102d40 2024-09-19T09:01:27.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.147+0000 7f95f27fc640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f95dc0a32d0 0x7f95dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.147+0000 7f95f8e34640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f95dc0a32d0 0x7f95dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.147+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f95e40cf270 con 0x7f95f4102d40 2024-09-19T09:01:27.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.147+0000 7f95f8e34640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f95dc0a32d0 0x7f95dc0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95f4102430 tx=0x7f95e8009910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.151+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f95e409bd20 con 0x7f95f4102d40 2024-09-19T09:01:27.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.354+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95f4106c80 con 0x7f95f4102d40 2024-09-19T09:01:27.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.355+0000 7f95f27fc640 1 -- 172.21.15.83:0/662370906 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f95e409b620 con 0x7f95f4102d40 2024-09-19T09:01:27.355 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:27.355 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"btime":"2024-09-19T09:01:17:195983+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:01:16.785988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[14583,24476,24430,24443,24445]},"id":1}]} 2024-09-19T09:01:27.355 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:01:27.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f95dc0a32d0 msgr2=0x7f95dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f95dc0a32d0 0x7f95dc0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95f4102430 tx=0x7f95e8009910 comp rx=0 tx=0).stop 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 msgr2=0x7f95f41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 0x7f95f41009a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95e400b4a0 tx=0x7f95e400b960 comp rx=0 tx=0).stop 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 shutdown_connections 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f95dc0a32d0 0x7f95dc0a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95f410c170 0x7f95f4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f4103660 0x7f95f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 --2- 172.21.15.83:0/662370906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95f4102d40 0x7f95f41009a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.357+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 >> 172.21.15.83:0/662370906 conn(0x7f95f40fc7a0 msgr2=0x7f95f40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.358+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 shutdown_connections 2024-09-19T09:01:27.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:27.358+0000 7f95fb899640 1 -- 172.21.15.83:0/662370906 wait complete. 2024-09-19T09:01:27.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:27 smithi184 ceph-mon[35007]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:27.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:27 smithi122 ceph-mon[34247]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:28.061 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:01:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:28 smithi184 ceph-mon[35007]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 24 op/s 2024-09-19T09:01:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:28 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/662370906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:28.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:28 smithi083 ceph-mon[30926]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 24 op/s 2024-09-19T09:01:28.427 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:28 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/662370906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:28.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:28 smithi122 ceph-mon[34247]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 24 op/s 2024-09-19T09:01:28.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:28 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/662370906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 -- 172.21.15.83:0/1170674955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc100e20 msgr2=0x7f01bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/1170674955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc100e20 0x7f01bc101200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009900 tx=0x7f01b802a480 comp rx=0 tx=0).stop 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 -- 172.21.15.83:0/1170674955 shutdown_connections 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/1170674955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01bc102ef0 0x7f01bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/1170674955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc102570 0x7f01bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/1170674955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc100e20 0x7f01bc101200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.788+0000 7f01c2ec9640 1 -- 172.21.15.83:0/1170674955 >> 172.21.15.83:0/1170674955 conn(0x7f01bc0fc7d0 msgr2=0x7f01bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 -- 172.21.15.83:0/1170674955 shutdown_connections 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 -- 172.21.15.83:0/1170674955 wait complete. 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 Processor -- start 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 -- start start 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc100e20 0x7f01bc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 0x7f01bc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01bc102ef0 0x7f01bc1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc110e30 con 0x7f01bc102570 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc110cb0 con 0x7f01bc100e20 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01c2ec9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc110fb0 con 0x7f01bc102ef0 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01b3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 0x7f01bc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:28.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01b3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 0x7f01bc1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49946/0 (socket says 172.21.15.83:49946) 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.789+0000 7f01b3fff640 1 -- 172.21.15.83:0/2677423527 learned_addr learned my addr 172.21.15.83:0/2677423527 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01c0c65640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc100e20 0x7f01bc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01c1466640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01bc102ef0 0x7f01bc1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b3fff640 1 -- 172.21.15.83:0/2677423527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01bc102ef0 msgr2=0x7f01bc1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b3fff640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01bc102ef0 0x7f01bc1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b3fff640 1 -- 172.21.15.83:0/2677423527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc100e20 msgr2=0x7f01bc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b3fff640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc100e20 0x7f01bc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b3fff640 1 -- 172.21.15.83:0/2677423527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc1a4840 con 0x7f01bc102570 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01c0c65640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc100e20 0x7f01bc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b3fff640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 0x7f01bc1997c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00d950 tx=0x7f01ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac017070 con 0x7f01bc102570 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01ac009c30 con 0x7f01bc102570 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc1a4a10 con 0x7f01bc102570 2024-09-19T09:01:28.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00f620 con 0x7f01bc102570 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.790+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01bc1a4f50 con 0x7f01bc102570 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.791+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01bc101200 con 0x7f01bc102570 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.792+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01ac0109a0 con 0x7f01bc102570 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.793+0000 7f01b1ffb640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f01a40a3350 0x7f01a40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.793+0000 7f01c0c65640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f01a40a3350 0x7f01a40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.793+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f01ac0cfa00 con 0x7f01bc102570 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.794+0000 7f01c0c65640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f01a40a3350 0x7f01a40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01b8005ab0 tx=0x7f01b8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:28.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.797+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01ac0d1e20 con 0x7f01bc102570 2024-09-19T09:01:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.967+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01bc109090 con 0x7f01bc102570 2024-09-19T09:01:28.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.969+0000 7f01b1ffb640 1 -- 172.21.15.83:0/2677423527 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7f01ac009de0 con 0x7f01bc102570 2024-09-19T09:01:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:28.970 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:01:28.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f01a40a3350 msgr2=0x7f01a40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:28.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f01a40a3350 0x7f01a40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01b8005ab0 tx=0x7f01b8005a20 comp rx=0 tx=0).stop 2024-09-19T09:01:28.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 msgr2=0x7f01bc1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 0x7f01bc1997c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00d950 tx=0x7f01ac00de10 comp rx=0 tx=0).stop 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 shutdown_connections 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f01a40a3350 0x7f01a40a5810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01bc102ef0 0x7f01bc1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01bc102570 0x7f01bc1997c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 --2- 172.21.15.83:0/2677423527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01bc100e20 0x7f01bc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 >> 172.21.15.83:0/2677423527 conn(0x7f01bc0fc7d0 msgr2=0x7f01bc0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 shutdown_connections 2024-09-19T09:01:28.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:28.971+0000 7f01c2ec9640 1 -- 172.21.15.83:0/2677423527 wait complete. 2024-09-19T09:01:29.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:29 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2677423527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:29.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:29 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2677423527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:29.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:29 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2677423527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:29.693 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:01:29.693 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:01:29.937 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:30.328 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:30 smithi083 ceph-mon[30926]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2024-09-19T09:01:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:30 smithi184 ceph-mon[35007]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 -- 172.21.15.83:0/2680585247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 msgr2=0x7f35bc1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2680585247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc1063d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ca0 tx=0x7f35b402a940 comp rx=0 tx=0).stop 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 -- 172.21.15.83:0/2680585247 shutdown_connections 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2680585247 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc1063d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2680585247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc101450 0x7f35bc105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2680585247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35bc100b30 0x7f35bc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 -- 172.21.15.83:0/2680585247 >> 172.21.15.83:0/2680585247 conn(0x7f35bc0fc7a0 msgr2=0x7f35bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:30.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 -- 172.21.15.83:0/2680585247 shutdown_connections 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.407+0000 7f35c3d78640 1 -- 172.21.15.83:0/2680585247 wait complete. 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 Processor -- start 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 -- start start 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc100b30 0x7f35bc1a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35bc101450 0x7f35bc1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc118410 con 0x7f35bc105f40 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc118290 con 0x7f35bc101450 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c3d78640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc118590 con 0x7f35bc100b30 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c2315640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c2315640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc19e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34324/0 (socket says 172.21.15.83:34324) 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c2315640 1 -- 172.21.15.83:0/2021749496 learned_addr learned my addr 172.21.15.83:0/2021749496 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:30.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c1313640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35bc101450 0x7f35bc1a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.408+0000 7f35c1b14640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc100b30 0x7f35bc1a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c2315640 1 -- 172.21.15.83:0/2021749496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc100b30 msgr2=0x7f35bc1a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c2315640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc100b30 0x7f35bc1a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c2315640 1 -- 172.21.15.83:0/2021749496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35bc101450 msgr2=0x7f35bc1a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c2315640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35bc101450 0x7f35bc1a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c2315640 1 -- 172.21.15.83:0/2021749496 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc19eec0 con 0x7f35bc105f40 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c1b14640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc100b30 0x7f35bc1a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c2315640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc19e650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009dc0 tx=0x7f35b402fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4034040 con 0x7f35bc105f40 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35b402fcb0 con 0x7f35bc105f40 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc19f150 con 0x7f35bc105f40 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4039430 con 0x7f35bc105f40 2024-09-19T09:01:30.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.409+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc1ab330 con 0x7f35bc105f40 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.410+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc06b070 con 0x7f35bc105f40 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.411+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f35b4037020 con 0x7f35bc105f40 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.412+0000 7f35b2ffd640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f35a80a3350 0x7f35a80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.412+0000 7f35c1b14640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f35a80a3350 0x7f35a80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.412+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f35b40f0f70 con 0x7f35bc105f40 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.412+0000 7f35c1b14640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f35a80a3350 0x7f35a80a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35b800baa0 tx=0x7f35b8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:30.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.415+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35b40bd960 con 0x7f35bc105f40 2024-09-19T09:01:30.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:30 smithi122 ceph-mon[34247]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2024-09-19T09:01:30.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.579+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35bc104fe0 con 0x7f35a80a3350 2024-09-19T09:01:30.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.588+0000 7f35b2ffd640 1 -- 172.21.15.83:0/2021749496 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340402 (secure 0 0 0) 0x7f35bc104fe0 con 0x7f35a80a3350 2024-09-19T09:01:30.593 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:30.594 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f35a80a3350 msgr2=0x7f35a80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f35a80a3350 0x7f35a80a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35b800baa0 tx=0x7f35b8005d90 comp rx=0 tx=0).stop 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 msgr2=0x7f35bc19e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc19e650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009dc0 tx=0x7f35b402fa90 comp rx=0 tx=0).stop 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 shutdown_connections 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f35a80a3350 0x7f35a80a5810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35bc105f40 0x7f35bc19e650 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35bc101450 0x7f35bc1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 --2- 172.21.15.83:0/2021749496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35bc100b30 0x7f35bc1a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 >> 172.21.15.83:0/2021749496 conn(0x7f35bc0fc7a0 msgr2=0x7f35bc1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 shutdown_connections 2024-09-19T09:01:30.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:30.591+0000 7f35c3d78640 1 -- 172.21.15.83:0/2021749496 wait complete. 2024-09-19T09:01:31.330 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-19T09:01:28.924403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641155,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":282,"num_read_kb":248,"num_write":413,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379576,"kb_used_data":13688,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562248,"statfs":{"total":1151940427776,"available":1151551741952,"internally_reserved":0,"allocated":14016512,"data_stored":7725071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45707,"num_objects":53,"num_object_clones":0,"num_object_copies":161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":143,"num_read_kb":126,"num_write":125,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003445"},"pg_stats":[{"pgid":"2.1f","version":"87'13","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:22.209704+0000","last_change":"2024-09-19T09:00:35.055195+0000","last_active":"2024-09-19T09:01:22.209704+0000","last_peered":"2024-09-19T09:01:22.209704+0000","last_clean":"2024-09-19T09:01:22.209704+0000","last_became_active":"2024-09-19T09:00:35.054878+0000","last_became_peered":"2024-09-19T09:00:35.054878+0000","last_unstale":"2024-09-19T09:01:22.209704+0000","last_undegraded":"2024-09-19T09:01:22.209704+0000","last_fullsized":"2024-09-19T09:01:22.209704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:40.719595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430908+0000","last_change":"2024-09-19T09:00:37.077470+0000","last_active":"2024-09-19T09:00:47.430908+0000","last_peered":"2024-09-19T09:00:47.430908+0000","last_clean":"2024-09-19T09:00:47.430908+0000","last_became_active":"2024-09-19T09:00:37.077158+0000","last_became_peered":"2024-09-19T09:00:37.077158+0000","last_unstale":"2024-09-19T09:00:47.430908+0000","last_undegraded":"2024-09-19T09:00:47.430908+0000","last_fullsized":"2024-09-19T09:00:47.430908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:00.350496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133878+0000","last_change":"2024-09-19T09:00:44.135294+0000","last_active":"2024-09-19T09:00:47.133878+0000","last_peered":"2024-09-19T09:00:47.133878+0000","last_clean":"2024-09-19T09:00:47.133878+0000","last_became_active":"2024-09-19T09:00:44.134844+0000","last_became_peered":"2024-09-19T09:00:44.134844+0000","last_unstale":"2024-09-19T09:00:47.133878+0000","last_undegraded":"2024-09-19T09:00:47.133878+0000","last_fullsized":"2024-09-19T09:00:47.133878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:06.231954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431232+0000","last_change":"2024-09-19T09:00:35.499941+0000","last_active":"2024-09-19T09:00:47.431232+0000","last_peered":"2024-09-19T09:00:47.431232+0000","last_clean":"2024-09-19T09:00:47.431232+0000","last_became_active":"2024-09-19T09:00:35.499463+0000","last_became_peered":"2024-09-19T09:00:35.499463+0000","last_unstale":"2024-09-19T09:00:47.431232+0000","last_undegraded":"2024-09-19T09:00:47.431232+0000","last_fullsized":"2024-09-19T09:00:47.431232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:15.603127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133565+0000","last_change":"2024-09-19T09:00:37.078318+0000","last_active":"2024-09-19T09:00:47.133565+0000","last_peered":"2024-09-19T09:00:47.133565+0000","last_clean":"2024-09-19T09:00:47.133565+0000","last_became_active":"2024-09-19T09:00:37.078037+0000","last_became_peered":"2024-09-19T09:00:37.078037+0000","last_unstale":"2024-09-19T09:00:47.133565+0000","last_undegraded":"2024-09-19T09:00:47.133565+0000","last_fullsized":"2024-09-19T09:00:47.133565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:41.860274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429810+0000","last_change":"2024-09-19T09:00:44.132012+0000","last_active":"2024-09-19T09:00:47.429810+0000","last_peered":"2024-09-19T09:00:47.429810+0000","last_clean":"2024-09-19T09:00:47.429810+0000","last_became_active":"2024-09-19T09:00:44.131238+0000","last_became_peered":"2024-09-19T09:00:44.131238+0000","last_unstale":"2024-09-19T09:00:47.429810+0000","last_undegraded":"2024-09-19T09:00:47.429810+0000","last_fullsized":"2024-09-19T09:00:47.429810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:07.931510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.199392+0000","last_change":"2024-09-19T09:00:35.059882+0000","last_active":"2024-09-19T09:01:15.199392+0000","last_peered":"2024-09-19T09:01:15.199392+0000","last_clean":"2024-09-19T09:01:15.199392+0000","last_became_active":"2024-09-19T09:00:35.059467+0000","last_became_peered":"2024-09-19T09:00:35.059467+0000","last_unstale":"2024-09-19T09:01:15.199392+0000","last_undegraded":"2024-09-19T09:01:15.199392+0000","last_fullsized":"2024-09-19T09:01:15.199392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:59.309282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430401+0000","last_change":"2024-09-19T09:00:37.078097+0000","last_active":"2024-09-19T09:00:47.430401+0000","last_peered":"2024-09-19T09:00:47.430401+0000","last_clean":"2024-09-19T09:00:47.430401+0000","last_became_active":"2024-09-19T09:00:37.077770+0000","last_became_peered":"2024-09-19T09:00:37.077770+0000","last_unstale":"2024-09-19T09:00:47.430401+0000","last_undegraded":"2024-09-19T09:00:47.430401+0000","last_fullsized":"2024-09-19T09:00:47.430401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:57.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431775+0000","last_change":"2024-09-19T09:00:44.128702+0000","last_active":"2024-09-19T09:00:47.431775+0000","last_peered":"2024-09-19T09:00:47.431775+0000","last_clean":"2024-09-19T09:00:47.431775+0000","last_became_active":"2024-09-19T09:00:44.128324+0000","last_became_peered":"2024-09-19T09:00:44.128324+0000","last_unstale":"2024-09-19T09:00:47.431775+0000","last_undegraded":"2024-09-19T09:00:47.431775+0000","last_fullsized":"2024-09-19T09:00:47.431775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:43.165912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198965+0000","last_change":"2024-09-19T09:00:35.057840+0000","last_active":"2024-09-19T09:01:15.198965+0000","last_peered":"2024-09-19T09:01:15.198965+0000","last_clean":"2024-09-19T09:01:15.198965+0000","last_became_active":"2024-09-19T09:00:35.057458+0000","last_became_peered":"2024-09-19T09:00:35.057458+0000","last_unstale":"2024-09-19T09:01:15.198965+0000","last_undegraded":"2024-09-19T09:01:15.198965+0000","last_fullsized":"2024-09-19T09:01:15.198965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:40.393892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431079+0000","last_change":"2024-09-19T09:00:37.082885+0000","last_active":"2024-09-19T09:00:47.431079+0000","last_peered":"2024-09-19T09:00:47.431079+0000","last_clean":"2024-09-19T09:00:47.431079+0000","last_became_active":"2024-09-19T09:00:37.082494+0000","last_became_peered":"2024-09-19T09:00:37.082494+0000","last_unstale":"2024-09-19T09:00:47.431079+0000","last_undegraded":"2024-09-19T09:00:47.431079+0000","last_fullsized":"2024-09-19T09:00:47.431079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:47.795093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430091+0000","last_change":"2024-09-19T09:00:44.126516+0000","last_active":"2024-09-19T09:00:47.430091+0000","last_peered":"2024-09-19T09:00:47.430091+0000","last_clean":"2024-09-19T09:00:47.430091+0000","last_became_active":"2024-09-19T09:00:44.125973+0000","last_became_peered":"2024-09-19T09:00:44.125973+0000","last_unstale":"2024-09-19T09:00:47.430091+0000","last_undegraded":"2024-09-19T09:00:47.430091+0000","last_fullsized":"2024-09-19T09:00:47.430091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:09.934473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430871+0000","last_change":"2024-09-19T09:00:37.079297+0000","last_active":"2024-09-19T09:00:47.430871+0000","last_peered":"2024-09-19T09:00:47.430871+0000","last_clean":"2024-09-19T09:00:47.430871+0000","last_became_active":"2024-09-19T09:00:37.078949+0000","last_became_peered":"2024-09-19T09:00:37.078949+0000","last_unstale":"2024-09-19T09:00:47.430871+0000","last_undegraded":"2024-09-19T09:00:47.430871+0000","last_fullsized":"2024-09-19T09:00:47.430871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:33.823014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:13.021101+0000","last_change":"2024-09-19T09:00:35.058467+0000","last_active":"2024-09-19T09:01:13.021101+0000","last_peered":"2024-09-19T09:01:13.021101+0000","last_clean":"2024-09-19T09:01:13.021101+0000","last_became_active":"2024-09-19T09:00:35.058103+0000","last_became_peered":"2024-09-19T09:00:35.058103+0000","last_unstale":"2024-09-19T09:01:13.021101+0000","last_undegraded":"2024-09-19T09:01:13.021101+0000","last_fullsized":"2024-09-19T09:01:13.021101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:29.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430971+0000","last_change":"2024-09-19T09:00:44.129381+0000","last_active":"2024-09-19T09:00:47.430971+0000","last_peered":"2024-09-19T09:00:47.430971+0000","last_clean":"2024-09-19T09:00:47.430971+0000","last_became_active":"2024-09-19T09:00:44.128984+0000","last_became_peered":"2024-09-19T09:00:44.128984+0000","last_unstale":"2024-09-19T09:00:47.430971+0000","last_undegraded":"2024-09-19T09:00:47.430971+0000","last_fullsized":"2024-09-19T09:00:47.430971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:28.427607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429745+0000","last_change":"2024-09-19T09:00:37.066684+0000","last_active":"2024-09-19T09:00:47.429745+0000","last_peered":"2024-09-19T09:00:47.429745+0000","last_clean":"2024-09-19T09:00:47.429745+0000","last_became_active":"2024-09-19T09:00:37.066401+0000","last_became_peered":"2024-09-19T09:00:37.066401+0000","last_unstale":"2024-09-19T09:00:47.429745+0000","last_undegraded":"2024-09-19T09:00:47.429745+0000","last_fullsized":"2024-09-19T09:00:47.429745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:54.344499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.032923+0000","last_change":"2024-09-19T09:00:44.123394+0000","last_active":"2024-09-19T09:01:15.032923+0000","last_peered":"2024-09-19T09:01:15.032923+0000","last_clean":"2024-09-19T09:01:15.032923+0000","last_became_active":"2024-09-19T09:00:44.122905+0000","last_became_peered":"2024-09-19T09:00:44.122905+0000","last_unstale":"2024-09-19T09:01:15.032923+0000","last_undegraded":"2024-09-19T09:01:15.032923+0000","last_fullsized":"2024-09-19T09:01:15.032923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.852333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431046+0000","last_change":"2024-09-19T09:00:44.134493+0000","last_active":"2024-09-19T09:00:47.431046+0000","last_peered":"2024-09-19T09:00:47.431046+0000","last_clean":"2024-09-19T09:00:47.431046+0000","last_became_active":"2024-09-19T09:00:44.133991+0000","last_became_peered":"2024-09-19T09:00:44.133991+0000","last_unstale":"2024-09-19T09:00:47.431046+0000","last_undegraded":"2024-09-19T09:00:47.431046+0000","last_fullsized":"2024-09-19T09:00:47.431046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:08.981672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431299+0000","last_change":"2024-09-19T09:00:37.077400+0000","last_active":"2024-09-19T09:00:47.431299+0000","last_peered":"2024-09-19T09:00:47.431299+0000","last_clean":"2024-09-19T09:00:47.431299+0000","last_became_active":"2024-09-19T09:00:37.077065+0000","last_became_peered":"2024-09-19T09:00:37.077065+0000","last_unstale":"2024-09-19T09:00:47.431299+0000","last_undegraded":"2024-09-19T09:00:47.431299+0000","last_fullsized":"2024-09-19T09:00:47.431299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:59.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198489+0000","last_change":"2024-09-19T09:00:35.053074+0000","last_active":"2024-09-19T09:01:15.198489+0000","last_peered":"2024-09-19T09:01:15.198489+0000","last_clean":"2024-09-19T09:01:15.198489+0000","last_became_active":"2024-09-19T09:00:35.052574+0000","last_became_peered":"2024-09-19T09:00:35.052574+0000","last_unstale":"2024-09-19T09:01:15.198489+0000","last_undegraded":"2024-09-19T09:01:15.198489+0000","last_fullsized":"2024-09-19T09:01:15.198489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:25.762622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430820+0000","last_change":"2024-09-19T09:00:44.132931+0000","last_active":"2024-09-19T09:00:47.430820+0000","last_peered":"2024-09-19T09:00:47.430820+0000","last_clean":"2024-09-19T09:00:47.430820+0000","last_became_active":"2024-09-19T09:00:44.132397+0000","last_became_peered":"2024-09-19T09:00:44.132397+0000","last_unstale":"2024-09-19T09:00:47.430820+0000","last_undegraded":"2024-09-19T09:00:47.430820+0000","last_fullsized":"2024-09-19T09:00:47.430820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.962417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429715+0000","last_change":"2024-09-19T09:00:37.077233+0000","last_active":"2024-09-19T09:00:47.429715+0000","last_peered":"2024-09-19T09:00:47.429715+0000","last_clean":"2024-09-19T09:00:47.429715+0000","last_became_active":"2024-09-19T09:00:37.076855+0000","last_became_peered":"2024-09-19T09:00:37.076855+0000","last_unstale":"2024-09-19T09:00:47.429715+0000","last_undegraded":"2024-09-19T09:00:47.429715+0000","last_fullsized":"2024-09-19T09:00:47.429715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:32.794488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:13.022993+0000","last_change":"2024-09-19T09:00:35.501157+0000","last_active":"2024-09-19T09:01:13.022993+0000","last_peered":"2024-09-19T09:01:13.022993+0000","last_clean":"2024-09-19T09:01:13.022993+0000","last_became_active":"2024-09-19T09:00:35.500869+0000","last_became_peered":"2024-09-19T09:00:35.500869+0000","last_unstale":"2024-09-19T09:01:13.022993+0000","last_undegraded":"2024-09-19T09:01:13.022993+0000","last_fullsized":"2024-09-19T09:01:13.022993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:44.333496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430993+0000","last_change":"2024-09-19T09:00:44.131479+0000","last_active":"2024-09-19T09:00:47.430993+0000","last_peered":"2024-09-19T09:00:47.430993+0000","last_clean":"2024-09-19T09:00:47.430993+0000","last_became_active":"2024-09-19T09:00:44.131058+0000","last_became_peered":"2024-09-19T09:00:44.131058+0000","last_unstale":"2024-09-19T09:00:47.430993+0000","last_undegraded":"2024-09-19T09:00:47.430993+0000","last_fullsized":"2024-09-19T09:00:47.430993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.980874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133389+0000","last_change":"2024-09-19T09:00:37.076590+0000","last_active":"2024-09-19T09:00:47.133389+0000","last_peered":"2024-09-19T09:00:47.133389+0000","last_clean":"2024-09-19T09:00:47.133389+0000","last_became_active":"2024-09-19T09:00:37.076287+0000","last_became_peered":"2024-09-19T09:00:37.076287+0000","last_unstale":"2024-09-19T09:00:47.133389+0000","last_undegraded":"2024-09-19T09:00:47.133389+0000","last_fullsized":"2024-09-19T09:00:47.133389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:22.237571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198709+0000","last_change":"2024-09-19T09:00:35.733174+0000","last_active":"2024-09-19T09:01:15.198709+0000","last_peered":"2024-09-19T09:01:15.198709+0000","last_clean":"2024-09-19T09:01:15.198709+0000","last_became_active":"2024-09-19T09:00:35.732824+0000","last_became_peered":"2024-09-19T09:00:35.732824+0000","last_unstale":"2024-09-19T09:01:15.198709+0000","last_undegraded":"2024-09-19T09:01:15.198709+0000","last_fullsized":"2024-09-19T09:01:15.198709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:15.143792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134011+0000","last_change":"2024-09-19T09:00:44.137095+0000","last_active":"2024-09-19T09:00:47.134011+0000","last_peered":"2024-09-19T09:00:47.134011+0000","last_clean":"2024-09-19T09:00:47.134011+0000","last_became_active":"2024-09-19T09:00:44.136697+0000","last_became_peered":"2024-09-19T09:00:44.136697+0000","last_unstale":"2024-09-19T09:00:47.134011+0000","last_undegraded":"2024-09-19T09:00:47.134011+0000","last_fullsized":"2024-09-19T09:00:47.134011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:14.316016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430286+0000","last_change":"2024-09-19T09:00:37.074155+0000","last_active":"2024-09-19T09:00:47.430286+0000","last_peered":"2024-09-19T09:00:47.430286+0000","last_clean":"2024-09-19T09:00:47.430286+0000","last_became_active":"2024-09-19T09:00:37.073819+0000","last_became_peered":"2024-09-19T09:00:37.073819+0000","last_unstale":"2024-09-19T09:00:47.430286+0000","last_undegraded":"2024-09-19T09:00:47.430286+0000","last_fullsized":"2024-09-19T09:00:47.430286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:18.598437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'10","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:21.071155+0000","last_change":"2024-09-19T09:00:35.055231+0000","last_active":"2024-09-19T09:01:21.071155+0000","last_peered":"2024-09-19T09:01:21.071155+0000","last_clean":"2024-09-19T09:01:21.071155+0000","last_became_active":"2024-09-19T09:00:35.054915+0000","last_became_peered":"2024-09-19T09:00:35.054915+0000","last_unstale":"2024-09-19T09:01:21.071155+0000","last_undegraded":"2024-09-19T09:01:21.071155+0000","last_fullsized":"2024-09-19T09:01:21.071155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:27.730738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429646+0000","last_change":"2024-09-19T09:00:44.134600+0000","last_active":"2024-09-19T09:00:47.429646+0000","last_peered":"2024-09-19T09:00:47.429646+0000","last_clean":"2024-09-19T09:00:47.429646+0000","last_became_active":"2024-09-19T09:00:44.134274+0000","last_became_peered":"2024-09-19T09:00:44.134274+0000","last_unstale":"2024-09-19T09:00:47.429646+0000","last_undegraded":"2024-09-19T09:00:47.429646+0000","last_fullsized":"2024-09-19T09:00:47.429646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:07.172654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430099+0000","last_change":"2024-09-19T09:00:37.075695+0000","last_active":"2024-09-19T09:00:47.430099+0000","last_peered":"2024-09-19T09:00:47.430099+0000","last_clean":"2024-09-19T09:00:47.430099+0000","last_became_active":"2024-09-19T09:00:37.075395+0000","last_became_peered":"2024-09-19T09:00:37.075395+0000","last_unstale":"2024-09-19T09:00:47.430099+0000","last_undegraded":"2024-09-19T09:00:47.430099+0000","last_fullsized":"2024-09-19T09:00:47.430099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.105953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.189864+0000","last_change":"2024-09-19T09:00:35.502029+0000","last_active":"2024-09-19T09:01:15.189864+0000","last_peered":"2024-09-19T09:01:15.189864+0000","last_clean":"2024-09-19T09:01:15.189864+0000","last_became_active":"2024-09-19T09:00:35.501535+0000","last_became_peered":"2024-09-19T09:00:35.501535+0000","last_unstale":"2024-09-19T09:01:15.189864+0000","last_undegraded":"2024-09-19T09:01:15.189864+0000","last_fullsized":"2024-09-19T09:01:15.189864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:12.104470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430493+0000","last_change":"2024-09-19T09:00:44.134361+0000","last_active":"2024-09-19T09:00:47.430493+0000","last_peered":"2024-09-19T09:00:47.430493+0000","last_clean":"2024-09-19T09:00:47.430493+0000","last_became_active":"2024-09-19T09:00:44.133859+0000","last_became_peered":"2024-09-19T09:00:44.133859+0000","last_unstale":"2024-09-19T09:00:47.430493+0000","last_undegraded":"2024-09-19T09:00:47.430493+0000","last_fullsized":"2024-09-19T09:00:47.430493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:29.075555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133974+0000","last_change":"2024-09-19T09:00:37.067259+0000","last_active":"2024-09-19T09:00:47.133974+0000","last_peered":"2024-09-19T09:00:47.133974+0000","last_clean":"2024-09-19T09:00:47.133974+0000","last_became_active":"2024-09-19T09:00:37.066932+0000","last_became_peered":"2024-09-19T09:00:37.066932+0000","last_unstale":"2024-09-19T09:00:47.133974+0000","last_undegraded":"2024-09-19T09:00:47.133974+0000","last_fullsized":"2024-09-19T09:00:47.133974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:09.205551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431243+0000","last_change":"2024-09-19T09:00:35.501139+0000","last_active":"2024-09-19T09:00:47.431243+0000","last_peered":"2024-09-19T09:00:47.431243+0000","last_clean":"2024-09-19T09:00:47.431243+0000","last_became_active":"2024-09-19T09:00:35.500790+0000","last_became_peered":"2024-09-19T09:00:35.500790+0000","last_unstale":"2024-09-19T09:00:47.431243+0000","last_undegraded":"2024-09-19T09:00:47.431243+0000","last_fullsized":"2024-09-19T09:00:47.431243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:51.811772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429893+0000","last_change":"2024-09-19T09:00:44.130524+0000","last_active":"2024-09-19T09:00:47.429893+0000","last_peered":"2024-09-19T09:00:47.429893+0000","last_clean":"2024-09-19T09:00:47.429893+0000","last_became_active":"2024-09-19T09:00:44.130002+0000","last_became_peered":"2024-09-19T09:00:44.130002+0000","last_unstale":"2024-09-19T09:00:47.429893+0000","last_undegraded":"2024-09-19T09:00:47.429893+0000","last_fullsized":"2024-09-19T09:00:47.429893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:35.060388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134117+0000","last_change":"2024-09-19T09:00:44.128716+0000","last_active":"2024-09-19T09:00:47.134117+0000","last_peered":"2024-09-19T09:00:47.134117+0000","last_clean":"2024-09-19T09:00:47.134117+0000","last_became_active":"2024-09-19T09:00:44.128295+0000","last_became_peered":"2024-09-19T09:00:44.128295+0000","last_unstale":"2024-09-19T09:00:47.134117+0000","last_undegraded":"2024-09-19T09:00:47.134117+0000","last_fullsized":"2024-09-19T09:00:47.134117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:55.576207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:22.210196+0000","last_change":"2024-09-19T09:00:35.057111+0000","last_active":"2024-09-19T09:01:22.210196+0000","last_peered":"2024-09-19T09:01:22.210196+0000","last_clean":"2024-09-19T09:01:22.210196+0000","last_became_active":"2024-09-19T09:00:35.056761+0000","last_became_peered":"2024-09-19T09:00:35.056761+0000","last_unstale":"2024-09-19T09:01:22.210196+0000","last_undegraded":"2024-09-19T09:01:22.210196+0000","last_fullsized":"2024-09-19T09:01:22.210196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:22.222798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430006+0000","last_change":"2024-09-19T09:00:44.130871+0000","last_active":"2024-09-19T09:00:47.430006+0000","last_peered":"2024-09-19T09:00:47.430006+0000","last_clean":"2024-09-19T09:00:47.430006+0000","last_became_active":"2024-09-19T09:00:44.130481+0000","last_became_peered":"2024-09-19T09:00:44.130481+0000","last_unstale":"2024-09-19T09:00:47.430006+0000","last_undegraded":"2024-09-19T09:00:47.430006+0000","last_fullsized":"2024-09-19T09:00:47.430006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:47.312776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430201+0000","last_change":"2024-09-19T09:00:37.077325+0000","last_active":"2024-09-19T09:00:47.430201+0000","last_peered":"2024-09-19T09:00:47.430201+0000","last_clean":"2024-09-19T09:00:47.430201+0000","last_became_active":"2024-09-19T09:00:37.076979+0000","last_became_peered":"2024-09-19T09:00:37.076979+0000","last_unstale":"2024-09-19T09:00:47.430201+0000","last_undegraded":"2024-09-19T09:00:47.430201+0000","last_fullsized":"2024-09-19T09:00:47.430201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:25.367304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:27.216230+0000","last_change":"2024-09-19T09:00:35.499862+0000","last_active":"2024-09-19T09:01:27.216230+0000","last_peered":"2024-09-19T09:01:27.216230+0000","last_clean":"2024-09-19T09:01:27.216230+0000","last_became_active":"2024-09-19T09:00:35.499534+0000","last_became_peered":"2024-09-19T09:00:35.499534+0000","last_unstale":"2024-09-19T09:01:27.216230+0000","last_undegraded":"2024-09-19T09:01:27.216230+0000","last_fullsized":"2024-09-19T09:01:27.216230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:21.008440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430798+0000","last_change":"2024-09-19T09:00:44.135298+0000","last_active":"2024-09-19T09:00:47.430798+0000","last_peered":"2024-09-19T09:00:47.430798+0000","last_clean":"2024-09-19T09:00:47.430798+0000","last_became_active":"2024-09-19T09:00:44.134899+0000","last_became_peered":"2024-09-19T09:00:44.134899+0000","last_unstale":"2024-09-19T09:00:47.430798+0000","last_undegraded":"2024-09-19T09:00:47.430798+0000","last_fullsized":"2024-09-19T09:00:47.430798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430226+0000","last_change":"2024-09-19T09:00:37.076195+0000","last_active":"2024-09-19T09:00:47.430226+0000","last_peered":"2024-09-19T09:00:47.430226+0000","last_clean":"2024-09-19T09:00:47.430226+0000","last_became_active":"2024-09-19T09:00:37.075906+0000","last_became_peered":"2024-09-19T09:00:37.075906+0000","last_unstale":"2024-09-19T09:00:47.430226+0000","last_undegraded":"2024-09-19T09:00:47.430226+0000","last_fullsized":"2024-09-19T09:00:47.430226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:47.724434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:14.027077+0000","last_change":"2024-09-19T09:00:35.059862+0000","last_active":"2024-09-19T09:01:14.027077+0000","last_peered":"2024-09-19T09:01:14.027077+0000","last_clean":"2024-09-19T09:01:14.027077+0000","last_became_active":"2024-09-19T09:00:35.058944+0000","last_became_peered":"2024-09-19T09:00:35.058944+0000","last_unstale":"2024-09-19T09:01:14.027077+0000","last_undegraded":"2024-09-19T09:01:14.027077+0000","last_fullsized":"2024-09-19T09:01:14.027077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:00.233367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431275+0000","last_change":"2024-09-19T09:00:44.133451+0000","last_active":"2024-09-19T09:00:47.431275+0000","last_peered":"2024-09-19T09:00:47.431275+0000","last_clean":"2024-09-19T09:00:47.431275+0000","last_became_active":"2024-09-19T09:00:44.133069+0000","last_became_peered":"2024-09-19T09:00:44.133069+0000","last_unstale":"2024-09-19T09:00:47.431275+0000","last_undegraded":"2024-09-19T09:00:47.431275+0000","last_fullsized":"2024-09-19T09:00:47.431275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:22.890861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430334+0000","last_change":"2024-09-19T09:00:44.132394+0000","last_active":"2024-09-19T09:00:47.430334+0000","last_peered":"2024-09-19T09:00:47.430334+0000","last_clean":"2024-09-19T09:00:47.430334+0000","last_became_active":"2024-09-19T09:00:44.132050+0000","last_became_peered":"2024-09-19T09:00:44.132050+0000","last_unstale":"2024-09-19T09:00:47.430334+0000","last_undegraded":"2024-09-19T09:00:47.430334+0000","last_fullsized":"2024-09-19T09:00:47.430334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:12.963885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198501+0000","last_change":"2024-09-19T09:00:35.055179+0000","last_active":"2024-09-19T09:01:15.198501+0000","last_peered":"2024-09-19T09:01:15.198501+0000","last_clean":"2024-09-19T09:01:15.198501+0000","last_became_active":"2024-09-19T09:00:35.054788+0000","last_became_peered":"2024-09-19T09:00:35.054788+0000","last_unstale":"2024-09-19T09:01:15.198501+0000","last_undegraded":"2024-09-19T09:01:15.198501+0000","last_fullsized":"2024-09-19T09:01:15.198501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:50.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430602+0000","last_change":"2024-09-19T08:59:22.943778+0000","last_active":"2024-09-19T09:00:47.430602+0000","last_peered":"2024-09-19T09:00:47.430602+0000","last_clean":"2024-09-19T09:00:47.430602+0000","last_became_active":"2024-09-19T08:59:22.943357+0000","last_became_peered":"2024-09-19T08:59:22.943357+0000","last_unstale":"2024-09-19T09:00:47.430602+0000","last_undegraded":"2024-09-19T09:00:47.430602+0000","last_fullsized":"2024-09-19T09:00:47.430602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_clean_scrub_stamp":"2024-09-19T08:55:57.183363+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:02.301026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431525+0000","last_change":"2024-09-19T09:00:44.135446+0000","last_active":"2024-09-19T09:00:47.431525+0000","last_peered":"2024-09-19T09:00:47.431525+0000","last_clean":"2024-09-19T09:00:47.431525+0000","last_became_active":"2024-09-19T09:00:44.135030+0000","last_became_peered":"2024-09-19T09:00:44.135030+0000","last_unstale":"2024-09-19T09:00:47.431525+0000","last_undegraded":"2024-09-19T09:00:47.431525+0000","last_fullsized":"2024-09-19T09:00:47.431525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:13.588934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431589+0000","last_change":"2024-09-19T09:00:37.079569+0000","last_active":"2024-09-19T09:00:47.431589+0000","last_peered":"2024-09-19T09:00:47.431589+0000","last_clean":"2024-09-19T09:00:47.431589+0000","last_became_active":"2024-09-19T09:00:37.079089+0000","last_became_peered":"2024-09-19T09:00:37.079089+0000","last_unstale":"2024-09-19T09:00:47.431589+0000","last_undegraded":"2024-09-19T09:00:47.431589+0000","last_fullsized":"2024-09-19T09:00:47.431589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:56.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:26.206893+0000","last_change":"2024-09-19T09:00:44.125607+0000","last_active":"2024-09-19T09:01:26.206893+0000","last_peered":"2024-09-19T09:01:26.206893+0000","last_clean":"2024-09-19T09:01:26.206893+0000","last_became_active":"2024-09-19T09:00:44.125236+0000","last_became_peered":"2024-09-19T09:00:44.125236+0000","last_unstale":"2024-09-19T09:01:26.206893+0000","last_undegraded":"2024-09-19T09:01:26.206893+0000","last_fullsized":"2024-09-19T09:01:26.206893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:21.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429920+0000","last_change":"2024-09-19T09:00:44.136886+0000","last_active":"2024-09-19T09:00:47.429920+0000","last_peered":"2024-09-19T09:00:47.429920+0000","last_clean":"2024-09-19T09:00:47.429920+0000","last_became_active":"2024-09-19T09:00:44.136394+0000","last_became_peered":"2024-09-19T09:00:44.136394+0000","last_unstale":"2024-09-19T09:00:47.429920+0000","last_undegraded":"2024-09-19T09:00:47.429920+0000","last_fullsized":"2024-09-19T09:00:47.429920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.680203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431246+0000","last_change":"2024-09-19T09:00:37.081017+0000","last_active":"2024-09-19T09:00:47.431246+0000","last_peered":"2024-09-19T09:00:47.431246+0000","last_clean":"2024-09-19T09:00:47.431246+0000","last_became_active":"2024-09-19T09:00:37.080674+0000","last_became_peered":"2024-09-19T09:00:37.080674+0000","last_unstale":"2024-09-19T09:00:47.431246+0000","last_undegraded":"2024-09-19T09:00:47.431246+0000","last_fullsized":"2024-09-19T09:00:47.431246+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:07.247315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.190094+0000","last_change":"2024-09-19T09:00:35.056009+0000","last_active":"2024-09-19T09:01:15.190094+0000","last_peered":"2024-09-19T09:01:15.190094+0000","last_clean":"2024-09-19T09:01:15.190094+0000","last_became_active":"2024-09-19T09:00:35.055651+0000","last_became_peered":"2024-09-19T09:00:35.055651+0000","last_unstale":"2024-09-19T09:01:15.190094+0000","last_undegraded":"2024-09-19T09:01:15.190094+0000","last_fullsized":"2024-09-19T09:01:15.190094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:36.726272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133311+0000","last_change":"2024-09-19T09:00:44.135629+0000","last_active":"2024-09-19T09:00:47.133311+0000","last_peered":"2024-09-19T09:00:47.133311+0000","last_clean":"2024-09-19T09:00:47.133311+0000","last_became_active":"2024-09-19T09:00:44.135253+0000","last_became_peered":"2024-09-19T09:00:44.135253+0000","last_unstale":"2024-09-19T09:00:47.133311+0000","last_undegraded":"2024-09-19T09:00:47.133311+0000","last_fullsized":"2024-09-19T09:00:47.133311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:37.767455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431472+0000","last_change":"2024-09-19T09:00:37.084042+0000","last_active":"2024-09-19T09:00:47.431472+0000","last_peered":"2024-09-19T09:00:47.431472+0000","last_clean":"2024-09-19T09:00:47.431472+0000","last_became_active":"2024-09-19T09:00:37.083512+0000","last_became_peered":"2024-09-19T09:00:37.083512+0000","last_unstale":"2024-09-19T09:00:47.431472+0000","last_undegraded":"2024-09-19T09:00:47.431472+0000","last_fullsized":"2024-09-19T09:00:47.431472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:07.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.196804+0000","last_change":"2024-09-19T09:00:35.056202+0000","last_active":"2024-09-19T09:01:15.196804+0000","last_peered":"2024-09-19T09:01:15.196804+0000","last_clean":"2024-09-19T09:01:15.196804+0000","last_became_active":"2024-09-19T09:00:35.055867+0000","last_became_peered":"2024-09-19T09:00:35.055867+0000","last_unstale":"2024-09-19T09:01:15.196804+0000","last_undegraded":"2024-09-19T09:01:15.196804+0000","last_fullsized":"2024-09-19T09:01:15.196804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:08.852400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430068+0000","last_change":"2024-09-19T09:00:44.133928+0000","last_active":"2024-09-19T09:00:47.430068+0000","last_peered":"2024-09-19T09:00:47.430068+0000","last_clean":"2024-09-19T09:00:47.430068+0000","last_became_active":"2024-09-19T09:00:44.133077+0000","last_became_peered":"2024-09-19T09:00:44.133077+0000","last_unstale":"2024-09-19T09:00:47.430068+0000","last_undegraded":"2024-09-19T09:00:47.430068+0000","last_fullsized":"2024-09-19T09:00:47.430068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:37.349942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431172+0000","last_change":"2024-09-19T09:00:37.080009+0000","last_active":"2024-09-19T09:00:47.431172+0000","last_peered":"2024-09-19T09:00:47.431172+0000","last_clean":"2024-09-19T09:00:47.431172+0000","last_became_active":"2024-09-19T09:00:37.079291+0000","last_became_peered":"2024-09-19T09:00:37.079291+0000","last_unstale":"2024-09-19T09:00:47.431172+0000","last_undegraded":"2024-09-19T09:00:47.431172+0000","last_fullsized":"2024-09-19T09:00:47.431172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:59.095093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.024702+0000","last_change":"2024-09-19T09:00:35.058866+0000","last_active":"2024-09-19T09:01:15.024702+0000","last_peered":"2024-09-19T09:01:15.024702+0000","last_clean":"2024-09-19T09:01:15.024702+0000","last_became_active":"2024-09-19T09:00:35.058318+0000","last_became_peered":"2024-09-19T09:00:35.058318+0000","last_unstale":"2024-09-19T09:01:15.024702+0000","last_undegraded":"2024-09-19T09:01:15.024702+0000","last_fullsized":"2024-09-19T09:01:15.024702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:32.183063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430141+0000","last_change":"2024-09-19T09:00:44.136564+0000","last_active":"2024-09-19T09:00:47.430141+0000","last_peered":"2024-09-19T09:00:47.430141+0000","last_clean":"2024-09-19T09:00:47.430141+0000","last_became_active":"2024-09-19T09:00:44.136192+0000","last_became_peered":"2024-09-19T09:00:44.136192+0000","last_unstale":"2024-09-19T09:00:47.430141+0000","last_undegraded":"2024-09-19T09:00:47.430141+0000","last_fullsized":"2024-09-19T09:00:47.430141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:17.856055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430320+0000","last_change":"2024-09-19T09:00:37.079611+0000","last_active":"2024-09-19T09:00:47.430320+0000","last_peered":"2024-09-19T09:00:47.430320+0000","last_clean":"2024-09-19T09:00:47.430320+0000","last_became_active":"2024-09-19T09:00:37.079135+0000","last_became_peered":"2024-09-19T09:00:37.079135+0000","last_unstale":"2024-09-19T09:00:47.430320+0000","last_undegraded":"2024-09-19T09:00:47.430320+0000","last_fullsized":"2024-09-19T09:00:47.430320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.321754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.190590+0000","last_change":"2024-09-19T09:00:44.144312+0000","last_active":"2024-09-19T09:01:15.190590+0000","last_peered":"2024-09-19T09:01:15.190590+0000","last_clean":"2024-09-19T09:01:15.190590+0000","last_became_active":"2024-09-19T09:00:44.128920+0000","last_became_peered":"2024-09-19T09:00:44.128920+0000","last_unstale":"2024-09-19T09:01:15.190590+0000","last_undegraded":"2024-09-19T09:01:15.190590+0000","last_fullsized":"2024-09-19T09:01:15.190590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:06.640129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430536+0000","last_change":"2024-09-19T09:00:44.134009+0000","last_active":"2024-09-19T09:00:47.430536+0000","last_peered":"2024-09-19T09:00:47.430536+0000","last_clean":"2024-09-19T09:00:47.430536+0000","last_became_active":"2024-09-19T09:00:44.133634+0000","last_became_peered":"2024-09-19T09:00:44.133634+0000","last_unstale":"2024-09-19T09:00:47.430536+0000","last_undegraded":"2024-09-19T09:00:47.430536+0000","last_fullsized":"2024-09-19T09:00:47.430536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.591618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430224+0000","last_change":"2024-09-19T09:00:37.082614+0000","last_active":"2024-09-19T09:00:47.430224+0000","last_peered":"2024-09-19T09:00:47.430224+0000","last_clean":"2024-09-19T09:00:47.430224+0000","last_became_active":"2024-09-19T09:00:37.082316+0000","last_became_peered":"2024-09-19T09:00:37.082316+0000","last_unstale":"2024-09-19T09:00:47.430224+0000","last_undegraded":"2024-09-19T09:00:47.430224+0000","last_fullsized":"2024-09-19T09:00:47.430224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:21.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:26.215460+0000","last_change":"2024-09-19T09:00:35.057270+0000","last_active":"2024-09-19T09:01:26.215460+0000","last_peered":"2024-09-19T09:01:26.215460+0000","last_clean":"2024-09-19T09:01:26.215460+0000","last_became_active":"2024-09-19T09:00:35.056955+0000","last_became_peered":"2024-09-19T09:00:35.056955+0000","last_unstale":"2024-09-19T09:01:26.215460+0000","last_undegraded":"2024-09-19T09:01:26.215460+0000","last_fullsized":"2024-09-19T09:01:26.215460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:11.609975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431140+0000","last_change":"2024-09-19T09:00:44.134923+0000","last_active":"2024-09-19T09:00:47.431140+0000","last_peered":"2024-09-19T09:00:47.431140+0000","last_clean":"2024-09-19T09:00:47.431140+0000","last_became_active":"2024-09-19T09:00:44.133804+0000","last_became_peered":"2024-09-19T09:00:44.133804+0000","last_unstale":"2024-09-19T09:00:47.431140+0000","last_undegraded":"2024-09-19T09:00:47.431140+0000","last_fullsized":"2024-09-19T09:00:47.431140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:34.680466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431379+0000","last_change":"2024-09-19T09:00:37.076171+0000","last_active":"2024-09-19T09:00:47.431379+0000","last_peered":"2024-09-19T09:00:47.431379+0000","last_clean":"2024-09-19T09:00:47.431379+0000","last_became_active":"2024-09-19T09:00:37.074936+0000","last_became_peered":"2024-09-19T09:00:37.074936+0000","last_unstale":"2024-09-19T09:00:47.431379+0000","last_undegraded":"2024-09-19T09:00:47.431379+0000","last_fullsized":"2024-09-19T09:00:47.431379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:40.122044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.196344+0000","last_change":"2024-09-19T09:00:35.055349+0000","last_active":"2024-09-19T09:01:15.196344+0000","last_peered":"2024-09-19T09:01:15.196344+0000","last_clean":"2024-09-19T09:01:15.196344+0000","last_became_active":"2024-09-19T09:00:35.054406+0000","last_became_peered":"2024-09-19T09:00:35.054406+0000","last_unstale":"2024-09-19T09:01:15.196344+0000","last_undegraded":"2024-09-19T09:01:15.196344+0000","last_fullsized":"2024-09-19T09:01:15.196344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:01.640009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430475+0000","last_change":"2024-09-19T09:00:44.133083+0000","last_active":"2024-09-19T09:00:47.430475+0000","last_peered":"2024-09-19T09:00:47.430475+0000","last_clean":"2024-09-19T09:00:47.430475+0000","last_became_active":"2024-09-19T09:00:44.132661+0000","last_became_peered":"2024-09-19T09:00:44.132661+0000","last_unstale":"2024-09-19T09:00:47.430475+0000","last_undegraded":"2024-09-19T09:00:47.430475+0000","last_fullsized":"2024-09-19T09:00:47.430475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:24.272169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430788+0000","last_change":"2024-09-19T09:00:37.073915+0000","last_active":"2024-09-19T09:00:47.430788+0000","last_peered":"2024-09-19T09:00:47.430788+0000","last_clean":"2024-09-19T09:00:47.430788+0000","last_became_active":"2024-09-19T09:00:37.073560+0000","last_became_peered":"2024-09-19T09:00:37.073560+0000","last_unstale":"2024-09-19T09:00:47.430788+0000","last_undegraded":"2024-09-19T09:00:47.430788+0000","last_fullsized":"2024-09-19T09:00:47.430788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.989827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198709+0000","last_change":"2024-09-19T09:00:35.056260+0000","last_active":"2024-09-19T09:01:15.198709+0000","last_peered":"2024-09-19T09:01:15.198709+0000","last_clean":"2024-09-19T09:01:15.198709+0000","last_became_active":"2024-09-19T09:00:35.055862+0000","last_became_peered":"2024-09-19T09:00:35.055862+0000","last_unstale":"2024-09-19T09:01:15.198709+0000","last_undegraded":"2024-09-19T09:01:15.198709+0000","last_fullsized":"2024-09-19T09:01:15.198709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:12.642021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431117+0000","last_change":"2024-09-19T09:00:44.132934+0000","last_active":"2024-09-19T09:00:47.431117+0000","last_peered":"2024-09-19T09:00:47.431117+0000","last_clean":"2024-09-19T09:00:47.431117+0000","last_became_active":"2024-09-19T09:00:44.132417+0000","last_became_peered":"2024-09-19T09:00:44.132417+0000","last_unstale":"2024-09-19T09:00:47.431117+0000","last_undegraded":"2024-09-19T09:00:47.431117+0000","last_fullsized":"2024-09-19T09:00:47.431117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:19.363149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430344+0000","last_change":"2024-09-19T09:00:37.081436+0000","last_active":"2024-09-19T09:00:47.430344+0000","last_peered":"2024-09-19T09:00:47.430344+0000","last_clean":"2024-09-19T09:00:47.430344+0000","last_became_active":"2024-09-19T09:00:37.081114+0000","last_became_peered":"2024-09-19T09:00:37.081114+0000","last_unstale":"2024-09-19T09:00:47.430344+0000","last_undegraded":"2024-09-19T09:00:47.430344+0000","last_fullsized":"2024-09-19T09:00:47.430344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:54.360471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'27","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:24.216183+0000","last_change":"2024-09-19T09:00:35.056632+0000","last_active":"2024-09-19T09:01:24.216183+0000","last_peered":"2024-09-19T09:01:24.216183+0000","last_clean":"2024-09-19T09:01:24.216183+0000","last_became_active":"2024-09-19T09:00:35.055468+0000","last_became_peered":"2024-09-19T09:00:35.055468+0000","last_unstale":"2024-09-19T09:01:24.216183+0000","last_undegraded":"2024-09-19T09:01:24.216183+0000","last_fullsized":"2024-09-19T09:01:24.216183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:01.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":55,"num_write":29,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430706+0000","last_change":"2024-09-19T09:00:44.128870+0000","last_active":"2024-09-19T09:00:47.430706+0000","last_peered":"2024-09-19T09:00:47.430706+0000","last_clean":"2024-09-19T09:00:47.430706+0000","last_became_active":"2024-09-19T09:00:44.128494+0000","last_became_peered":"2024-09-19T09:00:44.128494+0000","last_unstale":"2024-09-19T09:00:47.430706+0000","last_undegraded":"2024-09-19T09:00:47.430706+0000","last_fullsized":"2024-09-19T09:00:47.430706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:20.208407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430529+0000","last_change":"2024-09-19T09:00:37.086507+0000","last_active":"2024-09-19T09:00:47.430529+0000","last_peered":"2024-09-19T09:00:47.430529+0000","last_clean":"2024-09-19T09:00:47.430529+0000","last_became_active":"2024-09-19T09:00:37.086051+0000","last_became_peered":"2024-09-19T09:00:37.086051+0000","last_unstale":"2024-09-19T09:00:47.430529+0000","last_undegraded":"2024-09-19T09:00:47.430529+0000","last_fullsized":"2024-09-19T09:00:47.430529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:31.301804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.033244+0000","last_change":"2024-09-19T09:00:35.501772+0000","last_active":"2024-09-19T09:01:15.033244+0000","last_peered":"2024-09-19T09:01:15.033244+0000","last_clean":"2024-09-19T09:01:15.033244+0000","last_became_active":"2024-09-19T09:00:35.501413+0000","last_became_peered":"2024-09-19T09:00:35.501413+0000","last_unstale":"2024-09-19T09:01:15.033244+0000","last_undegraded":"2024-09-19T09:01:15.033244+0000","last_fullsized":"2024-09-19T09:01:15.033244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:31.806234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431549+0000","last_change":"2024-09-19T09:00:44.132702+0000","last_active":"2024-09-19T09:00:47.431549+0000","last_peered":"2024-09-19T09:00:47.431549+0000","last_clean":"2024-09-19T09:00:47.431549+0000","last_became_active":"2024-09-19T09:00:44.132218+0000","last_became_peered":"2024-09-19T09:00:44.132218+0000","last_unstale":"2024-09-19T09:00:47.431549+0000","last_undegraded":"2024-09-19T09:00:47.431549+0000","last_fullsized":"2024-09-19T09:00:47.431549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:48.884328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133576+0000","last_change":"2024-09-19T09:00:37.078120+0000","last_active":"2024-09-19T09:00:47.133576+0000","last_peered":"2024-09-19T09:00:47.133576+0000","last_clean":"2024-09-19T09:00:47.133576+0000","last_became_active":"2024-09-19T09:00:37.077885+0000","last_became_peered":"2024-09-19T09:00:37.077885+0000","last_unstale":"2024-09-19T09:00:47.133576+0000","last_undegraded":"2024-09-19T09:00:47.133576+0000","last_fullsized":"2024-09-19T09:00:47.133576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:01.841615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198830+0000","last_change":"2024-09-19T09:00:35.059612+0000","last_active":"2024-09-19T09:01:15.198830+0000","last_peered":"2024-09-19T09:01:15.198830+0000","last_clean":"2024-09-19T09:01:15.198830+0000","last_became_active":"2024-09-19T09:00:35.059191+0000","last_became_peered":"2024-09-19T09:00:35.059191+0000","last_unstale":"2024-09-19T09:01:15.198830+0000","last_undegraded":"2024-09-19T09:01:15.198830+0000","last_fullsized":"2024-09-19T09:01:15.198830+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:06.600073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429932+0000","last_change":"2024-09-19T09:00:44.131867+0000","last_active":"2024-09-19T09:00:47.429932+0000","last_peered":"2024-09-19T09:00:47.429932+0000","last_clean":"2024-09-19T09:00:47.429932+0000","last_became_active":"2024-09-19T09:00:44.131492+0000","last_became_peered":"2024-09-19T09:00:44.131492+0000","last_unstale":"2024-09-19T09:00:47.429932+0000","last_undegraded":"2024-09-19T09:00:47.429932+0000","last_fullsized":"2024-09-19T09:00:47.429932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:35.746606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430706+0000","last_change":"2024-09-19T09:00:37.080025+0000","last_active":"2024-09-19T09:00:47.430706+0000","last_peered":"2024-09-19T09:00:47.430706+0000","last_clean":"2024-09-19T09:00:47.430706+0000","last_became_active":"2024-09-19T09:00:37.078012+0000","last_became_peered":"2024-09-19T09:00:37.078012+0000","last_unstale":"2024-09-19T09:00:47.430706+0000","last_undegraded":"2024-09-19T09:00:47.430706+0000","last_fullsized":"2024-09-19T09:00:47.430706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:25.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:24.204447+0000","last_change":"2024-09-19T09:00:35.059391+0000","last_active":"2024-09-19T09:01:24.204447+0000","last_peered":"2024-09-19T09:01:24.204447+0000","last_clean":"2024-09-19T09:01:24.204447+0000","last_became_active":"2024-09-19T09:00:35.059049+0000","last_became_peered":"2024-09-19T09:00:35.059049+0000","last_unstale":"2024-09-19T09:01:24.204447+0000","last_undegraded":"2024-09-19T09:01:24.204447+0000","last_fullsized":"2024-09-19T09:01:24.204447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:00.531411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429558+0000","last_change":"2024-09-19T09:00:44.133665+0000","last_active":"2024-09-19T09:00:47.429558+0000","last_peered":"2024-09-19T09:00:47.429558+0000","last_clean":"2024-09-19T09:00:47.429558+0000","last_became_active":"2024-09-19T09:00:44.133297+0000","last_became_peered":"2024-09-19T09:00:44.133297+0000","last_unstale":"2024-09-19T09:00:47.429558+0000","last_undegraded":"2024-09-19T09:00:47.429558+0000","last_fullsized":"2024-09-19T09:00:47.429558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:18.279936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133396+0000","last_change":"2024-09-19T09:00:44.136292+0000","last_active":"2024-09-19T09:00:47.133396+0000","last_peered":"2024-09-19T09:00:47.133396+0000","last_clean":"2024-09-19T09:00:47.133396+0000","last_became_active":"2024-09-19T09:00:44.135914+0000","last_became_peered":"2024-09-19T09:00:44.135914+0000","last_unstale":"2024-09-19T09:00:47.133396+0000","last_undegraded":"2024-09-19T09:00:47.133396+0000","last_fullsized":"2024-09-19T09:00:47.133396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:00.998217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429903+0000","last_change":"2024-09-19T09:00:37.066933+0000","last_active":"2024-09-19T09:00:47.429903+0000","last_peered":"2024-09-19T09:00:47.429903+0000","last_clean":"2024-09-19T09:00:47.429903+0000","last_became_active":"2024-09-19T09:00:37.066634+0000","last_became_peered":"2024-09-19T09:00:37.066634+0000","last_unstale":"2024-09-19T09:00:47.429903+0000","last_undegraded":"2024-09-19T09:00:47.429903+0000","last_fullsized":"2024-09-19T09:00:47.429903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.192546+0000","last_change":"2024-09-19T09:00:35.057495+0000","last_active":"2024-09-19T09:01:15.192546+0000","last_peered":"2024-09-19T09:01:15.192546+0000","last_clean":"2024-09-19T09:01:15.192546+0000","last_became_active":"2024-09-19T09:00:35.057093+0000","last_became_peered":"2024-09-19T09:00:35.057093+0000","last_unstale":"2024-09-19T09:01:15.192546+0000","last_undegraded":"2024-09-19T09:01:15.192546+0000","last_fullsized":"2024-09-19T09:01:15.192546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:41.278464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431365+0000","last_change":"2024-09-19T09:00:44.135353+0000","last_active":"2024-09-19T09:00:47.431365+0000","last_peered":"2024-09-19T09:00:47.431365+0000","last_clean":"2024-09-19T09:00:47.431365+0000","last_became_active":"2024-09-19T09:00:44.134467+0000","last_became_peered":"2024-09-19T09:00:44.134467+0000","last_unstale":"2024-09-19T09:00:47.431365+0000","last_undegraded":"2024-09-19T09:00:47.431365+0000","last_fullsized":"2024-09-19T09:00:47.431365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:28.795561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429947+0000","last_change":"2024-09-19T09:00:37.067368+0000","last_active":"2024-09-19T09:00:47.429947+0000","last_peered":"2024-09-19T09:00:47.429947+0000","last_clean":"2024-09-19T09:00:47.429947+0000","last_became_active":"2024-09-19T09:00:37.067081+0000","last_became_peered":"2024-09-19T09:00:37.067081+0000","last_unstale":"2024-09-19T09:00:47.429947+0000","last_undegraded":"2024-09-19T09:00:47.429947+0000","last_fullsized":"2024-09-19T09:00:47.429947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:42.069148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:14.029135+0000","last_change":"2024-09-19T09:00:35.052775+0000","last_active":"2024-09-19T09:01:14.029135+0000","last_peered":"2024-09-19T09:01:14.029135+0000","last_clean":"2024-09-19T09:01:14.029135+0000","last_became_active":"2024-09-19T09:00:35.052419+0000","last_became_peered":"2024-09-19T09:00:35.052419+0000","last_unstale":"2024-09-19T09:01:14.029135+0000","last_undegraded":"2024-09-19T09:01:14.029135+0000","last_fullsized":"2024-09-19T09:01:14.029135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:40.156076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.033383+0000","last_change":"2024-09-19T09:00:35.055043+0000","last_active":"2024-09-19T09:01:15.033383+0000","last_peered":"2024-09-19T09:01:15.033383+0000","last_clean":"2024-09-19T09:01:15.033383+0000","last_became_active":"2024-09-19T09:00:35.054653+0000","last_became_peered":"2024-09-19T09:00:35.054653+0000","last_unstale":"2024-09-19T09:01:15.033383+0000","last_undegraded":"2024-09-19T09:01:15.033383+0000","last_fullsized":"2024-09-19T09:01:15.033383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.834239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430782+0000","last_change":"2024-09-19T09:00:37.077459+0000","last_active":"2024-09-19T09:00:47.430782+0000","last_peered":"2024-09-19T09:00:47.430782+0000","last_clean":"2024-09-19T09:00:47.430782+0000","last_became_active":"2024-09-19T09:00:37.077130+0000","last_became_peered":"2024-09-19T09:00:37.077130+0000","last_unstale":"2024-09-19T09:00:47.430782+0000","last_undegraded":"2024-09-19T09:00:47.430782+0000","last_fullsized":"2024-09-19T09:00:47.430782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:36.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134278+0000","last_change":"2024-09-19T09:00:44.133996+0000","last_active":"2024-09-19T09:00:47.134278+0000","last_peered":"2024-09-19T09:00:47.134278+0000","last_clean":"2024-09-19T09:00:47.134278+0000","last_became_active":"2024-09-19T09:00:44.133628+0000","last_became_peered":"2024-09-19T09:00:44.133628+0000","last_unstale":"2024-09-19T09:00:47.134278+0000","last_undegraded":"2024-09-19T09:00:47.134278+0000","last_fullsized":"2024-09-19T09:00:47.134278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:50.332457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:25.210893+0000","last_change":"2024-09-19T09:00:35.053940+0000","last_active":"2024-09-19T09:01:25.210893+0000","last_peered":"2024-09-19T09:01:25.210893+0000","last_clean":"2024-09-19T09:01:25.210893+0000","last_became_active":"2024-09-19T09:00:35.053537+0000","last_became_peered":"2024-09-19T09:00:35.053537+0000","last_unstale":"2024-09-19T09:01:25.210893+0000","last_undegraded":"2024-09-19T09:01:25.210893+0000","last_fullsized":"2024-09-19T09:01:25.210893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:34.127981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429934+0000","last_change":"2024-09-19T09:00:37.080739+0000","last_active":"2024-09-19T09:00:47.429934+0000","last_peered":"2024-09-19T09:00:47.429934+0000","last_clean":"2024-09-19T09:00:47.429934+0000","last_became_active":"2024-09-19T09:00:37.077474+0000","last_became_peered":"2024-09-19T09:00:37.077474+0000","last_unstale":"2024-09-19T09:00:47.429934+0000","last_undegraded":"2024-09-19T09:00:47.429934+0000","last_fullsized":"2024-09-19T09:00:47.429934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:50.963793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134365+0000","last_change":"2024-09-19T09:00:44.136011+0000","last_active":"2024-09-19T09:00:47.134365+0000","last_peered":"2024-09-19T09:00:47.134365+0000","last_clean":"2024-09-19T09:00:47.134365+0000","last_became_active":"2024-09-19T09:00:44.135614+0000","last_became_peered":"2024-09-19T09:00:44.135614+0000","last_unstale":"2024-09-19T09:00:47.134365+0000","last_undegraded":"2024-09-19T09:00:47.134365+0000","last_fullsized":"2024-09-19T09:00:47.134365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:49.390677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431198+0000","last_change":"2024-09-19T09:00:37.081680+0000","last_active":"2024-09-19T09:00:47.431198+0000","last_peered":"2024-09-19T09:00:47.431198+0000","last_clean":"2024-09-19T09:00:47.431198+0000","last_became_active":"2024-09-19T09:00:37.081355+0000","last_became_peered":"2024-09-19T09:00:37.081355+0000","last_unstale":"2024-09-19T09:00:47.431198+0000","last_undegraded":"2024-09-19T09:00:47.431198+0000","last_fullsized":"2024-09-19T09:00:47.431198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:49.101880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134124+0000","last_change":"2024-09-19T09:00:37.076575+0000","last_active":"2024-09-19T09:00:47.134124+0000","last_peered":"2024-09-19T09:00:47.134124+0000","last_clean":"2024-09-19T09:00:47.134124+0000","last_became_active":"2024-09-19T09:00:37.076167+0000","last_became_peered":"2024-09-19T09:00:37.076167+0000","last_unstale":"2024-09-19T09:00:47.134124+0000","last_undegraded":"2024-09-19T09:00:47.134124+0000","last_fullsized":"2024-09-19T09:00:47.134124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:08.251308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133853+0000","last_change":"2024-09-19T09:00:37.080433+0000","last_active":"2024-09-19T09:00:47.133853+0000","last_peered":"2024-09-19T09:00:47.133853+0000","last_clean":"2024-09-19T09:00:47.133853+0000","last_became_active":"2024-09-19T09:00:37.074803+0000","last_became_peered":"2024-09-19T09:00:37.074803+0000","last_unstale":"2024-09-19T09:00:47.133853+0000","last_undegraded":"2024-09-19T09:00:47.133853+0000","last_fullsized":"2024-09-19T09:00:47.133853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:18.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133271+0000","last_change":"2024-09-19T09:00:37.073227+0000","last_active":"2024-09-19T09:00:47.133271+0000","last_peered":"2024-09-19T09:00:47.133271+0000","last_clean":"2024-09-19T09:00:47.133271+0000","last_became_active":"2024-09-19T09:00:37.072875+0000","last_became_peered":"2024-09-19T09:00:37.072875+0000","last_unstale":"2024-09-19T09:00:47.133271+0000","last_undegraded":"2024-09-19T09:00:47.133271+0000","last_fullsized":"2024-09-19T09:00:47.133271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:09.303029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430039+0000","last_change":"2024-09-19T09:00:37.077978+0000","last_active":"2024-09-19T09:00:47.430039+0000","last_peered":"2024-09-19T09:00:47.430039+0000","last_clean":"2024-09-19T09:00:47.430039+0000","last_became_active":"2024-09-19T09:00:37.077663+0000","last_became_peered":"2024-09-19T09:00:37.077663+0000","last_unstale":"2024-09-19T09:00:47.430039+0000","last_undegraded":"2024-09-19T09:00:47.430039+0000","last_fullsized":"2024-09-19T09:00:47.430039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:22.156471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430909+0000","last_change":"2024-09-19T09:00:37.086723+0000","last_active":"2024-09-19T09:00:47.430909+0000","last_peered":"2024-09-19T09:00:47.430909+0000","last_clean":"2024-09-19T09:00:47.430909+0000","last_became_active":"2024-09-19T09:00:37.086405+0000","last_became_peered":"2024-09-19T09:00:37.086405+0000","last_unstale":"2024-09-19T09:00:47.430909+0000","last_undegraded":"2024-09-19T09:00:47.430909+0000","last_fullsized":"2024-09-19T09:00:47.430909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:21.351964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134487+0000","last_change":"2024-09-19T09:00:37.083033+0000","last_active":"2024-09-19T09:00:47.134487+0000","last_peered":"2024-09-19T09:00:47.134487+0000","last_clean":"2024-09-19T09:00:47.134487+0000","last_became_active":"2024-09-19T09:00:37.082713+0000","last_became_peered":"2024-09-19T09:00:37.082713+0000","last_unstale":"2024-09-19T09:00:47.134487+0000","last_undegraded":"2024-09-19T09:00:47.134487+0000","last_fullsized":"2024-09-19T09:00:47.134487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:27.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430196+0000","last_change":"2024-09-19T09:00:37.076327+0000","last_active":"2024-09-19T09:00:47.430196+0000","last_peered":"2024-09-19T09:00:47.430196+0000","last_clean":"2024-09-19T09:00:47.430196+0000","last_became_active":"2024-09-19T09:00:37.076015+0000","last_became_peered":"2024-09-19T09:00:37.076015+0000","last_unstale":"2024-09-19T09:00:47.430196+0000","last_undegraded":"2024-09-19T09:00:47.430196+0000","last_fullsized":"2024-09-19T09:00:47.430196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.789995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430085+0000","last_change":"2024-09-19T09:00:37.076633+0000","last_active":"2024-09-19T09:00:47.430085+0000","last_peered":"2024-09-19T09:00:47.430085+0000","last_clean":"2024-09-19T09:00:47.430085+0000","last_became_active":"2024-09-19T09:00:37.075725+0000","last_became_peered":"2024-09-19T09:00:37.075725+0000","last_unstale":"2024-09-19T09:00:47.430085+0000","last_undegraded":"2024-09-19T09:00:47.430085+0000","last_fullsized":"2024-09-19T09:00:47.430085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:44.927819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429710+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:00:47.429710+0000","last_peered":"2024-09-19T09:00:47.429710+0000","last_clean":"2024-09-19T09:00:47.429710+0000","last_became_active":"2024-09-19T09:00:37.084998+0000","last_became_peered":"2024-09-19T09:00:37.084998+0000","last_unstale":"2024-09-19T09:00:47.429710+0000","last_undegraded":"2024-09-19T09:00:47.429710+0000","last_fullsized":"2024-09-19T09:00:47.429710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:57.316550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430159+0000","last_change":"2024-09-19T09:00:37.076500+0000","last_active":"2024-09-19T09:00:47.430159+0000","last_peered":"2024-09-19T09:00:47.430159+0000","last_clean":"2024-09-19T09:00:47.430159+0000","last_became_active":"2024-09-19T09:00:37.076135+0000","last_became_peered":"2024-09-19T09:00:37.076135+0000","last_unstale":"2024-09-19T09:00:47.430159+0000","last_undegraded":"2024-09-19T09:00:47.430159+0000","last_fullsized":"2024-09-19T09:00:47.430159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:06.726704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429878+0000","last_change":"2024-09-19T09:00:37.074370+0000","last_active":"2024-09-19T09:00:47.429878+0000","last_peered":"2024-09-19T09:00:47.429878+0000","last_clean":"2024-09-19T09:00:47.429878+0000","last_became_active":"2024-09-19T09:00:37.074076+0000","last_became_peered":"2024-09-19T09:00:37.074076+0000","last_unstale":"2024-09-19T09:00:47.429878+0000","last_undegraded":"2024-09-19T09:00:47.429878+0000","last_fullsized":"2024-09-19T09:00:47.429878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:56.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430581+0000","last_change":"2024-09-19T09:00:37.078887+0000","last_active":"2024-09-19T09:00:47.430581+0000","last_peered":"2024-09-19T09:00:47.430581+0000","last_clean":"2024-09-19T09:00:47.430581+0000","last_became_active":"2024-09-19T09:00:37.078192+0000","last_became_peered":"2024-09-19T09:00:37.078192+0000","last_unstale":"2024-09-19T09:00:47.430581+0000","last_undegraded":"2024-09-19T09:00:47.430581+0000","last_fullsized":"2024-09-19T09:00:47.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134442+0000","last_change":"2024-09-19T09:00:37.075932+0000","last_active":"2024-09-19T09:00:47.134442+0000","last_peered":"2024-09-19T09:00:47.134442+0000","last_clean":"2024-09-19T09:00:47.134442+0000","last_became_active":"2024-09-19T09:00:37.074637+0000","last_became_peered":"2024-09-19T09:00:37.074637+0000","last_unstale":"2024-09-19T09:00:47.134442+0000","last_undegraded":"2024-09-19T09:00:47.134442+0000","last_fullsized":"2024-09-19T09:00:47.134442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:27.423717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430890+0000","last_change":"2024-09-19T09:00:37.072804+0000","last_active":"2024-09-19T09:00:47.430890+0000","last_peered":"2024-09-19T09:00:47.430890+0000","last_clean":"2024-09-19T09:00:47.430890+0000","last_became_active":"2024-09-19T09:00:37.072500+0000","last_became_peered":"2024-09-19T09:00:37.072500+0000","last_unstale":"2024-09-19T09:00:47.430890+0000","last_undegraded":"2024-09-19T09:00:47.430890+0000","last_fullsized":"2024-09-19T09:00:47.430890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:56.035111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431747+0000","last_change":"2024-09-19T09:00:37.083195+0000","last_active":"2024-09-19T09:00:47.431747+0000","last_peered":"2024-09-19T09:00:47.431747+0000","last_clean":"2024-09-19T09:00:47.431747+0000","last_became_active":"2024-09-19T09:00:37.082332+0000","last_became_peered":"2024-09-19T09:00:37.082332+0000","last_unstale":"2024-09-19T09:00:47.431747+0000","last_undegraded":"2024-09-19T09:00:47.431747+0000","last_fullsized":"2024-09-19T09:00:47.431747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:12.802785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429829+0000","last_change":"2024-09-19T09:00:37.076955+0000","last_active":"2024-09-19T09:00:47.429829+0000","last_peered":"2024-09-19T09:00:47.429829+0000","last_clean":"2024-09-19T09:00:47.429829+0000","last_became_active":"2024-09-19T09:00:37.076637+0000","last_became_peered":"2024-09-19T09:00:37.076637+0000","last_unstale":"2024-09-19T09:00:47.429829+0000","last_undegraded":"2024-09-19T09:00:47.429829+0000","last_fullsized":"2024-09-19T09:00:47.429829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:51.181157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133095+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:00:47.133095+0000","last_peered":"2024-09-19T09:00:47.133095+0000","last_clean":"2024-09-19T09:00:47.133095+0000","last_became_active":"2024-09-19T09:00:37.084976+0000","last_became_peered":"2024-09-19T09:00:37.084976+0000","last_unstale":"2024-09-19T09:00:47.133095+0000","last_undegraded":"2024-09-19T09:00:47.133095+0000","last_fullsized":"2024-09-19T09:00:47.133095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:23.120946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133150+0000","last_change":"2024-09-19T09:00:37.082788+0000","last_active":"2024-09-19T09:00:47.133150+0000","last_peered":"2024-09-19T09:00:47.133150+0000","last_clean":"2024-09-19T09:00:47.133150+0000","last_became_active":"2024-09-19T09:00:37.082460+0000","last_became_peered":"2024-09-19T09:00:37.082460+0000","last_unstale":"2024-09-19T09:00:47.133150+0000","last_undegraded":"2024-09-19T09:00:47.133150+0000","last_fullsized":"2024-09-19T09:00:47.133150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:17.191671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429778+0000","last_change":"2024-09-19T09:00:37.075908+0000","last_active":"2024-09-19T09:00:47.429778+0000","last_peered":"2024-09-19T09:00:47.429778+0000","last_clean":"2024-09-19T09:00:47.429778+0000","last_became_active":"2024-09-19T09:00:37.075579+0000","last_became_peered":"2024-09-19T09:00:37.075579+0000","last_unstale":"2024-09-19T09:00:47.429778+0000","last_undegraded":"2024-09-19T09:00:47.429778+0000","last_fullsized":"2024-09-19T09:00:47.429778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:53.620585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431281+0000","last_change":"2024-09-19T09:00:37.084392+0000","last_active":"2024-09-19T09:00:47.431281+0000","last_peered":"2024-09-19T09:00:47.431281+0000","last_clean":"2024-09-19T09:00:47.431281+0000","last_became_active":"2024-09-19T09:00:37.084074+0000","last_became_peered":"2024-09-19T09:00:37.084074+0000","last_unstale":"2024-09-19T09:00:47.431281+0000","last_undegraded":"2024-09-19T09:00:47.431281+0000","last_fullsized":"2024-09-19T09:00:47.431281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:20.585494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431530+0000","last_change":"2024-09-19T09:00:37.084436+0000","last_active":"2024-09-19T09:00:47.431530+0000","last_peered":"2024-09-19T09:00:47.431530+0000","last_clean":"2024-09-19T09:00:47.431530+0000","last_became_active":"2024-09-19T09:00:37.083720+0000","last_became_peered":"2024-09-19T09:00:37.083720+0000","last_unstale":"2024-09-19T09:00:47.431530+0000","last_undegraded":"2024-09-19T09:00:47.431530+0000","last_fullsized":"2024-09-19T09:00:47.431530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.900914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134442+0000","last_change":"2024-09-19T09:00:37.080816+0000","last_active":"2024-09-19T09:00:47.134442+0000","last_peered":"2024-09-19T09:00:47.134442+0000","last_clean":"2024-09-19T09:00:47.134442+0000","last_became_active":"2024-09-19T09:00:37.080493+0000","last_became_peered":"2024-09-19T09:00:37.080493+0000","last_unstale":"2024-09-19T09:00:47.134442+0000","last_undegraded":"2024-09-19T09:00:47.134442+0000","last_fullsized":"2024-09-19T09:00:47.134442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:18.862965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430970+0000","last_change":"2024-09-19T09:00:37.079203+0000","last_active":"2024-09-19T09:00:47.430970+0000","last_peered":"2024-09-19T09:00:47.430970+0000","last_clean":"2024-09-19T09:00:47.430970+0000","last_became_active":"2024-09-19T09:00:37.078851+0000","last_became_peered":"2024-09-19T09:00:37.078851+0000","last_unstale":"2024-09-19T09:00:47.430970+0000","last_undegraded":"2024-09-19T09:00:47.430970+0000","last_fullsized":"2024-09-19T09:00:47.430970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:16.640023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429655+0000","last_change":"2024-09-19T09:00:37.077327+0000","last_active":"2024-09-19T09:00:47.429655+0000","last_peered":"2024-09-19T09:00:47.429655+0000","last_clean":"2024-09-19T09:00:47.429655+0000","last_became_active":"2024-09-19T09:00:37.077016+0000","last_became_peered":"2024-09-19T09:00:37.077016+0000","last_unstale":"2024-09-19T09:00:47.429655+0000","last_undegraded":"2024-09-19T09:00:47.429655+0000","last_fullsized":"2024-09-19T09:00:47.429655+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:39.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430365+0000","last_change":"2024-09-19T09:00:37.081849+0000","last_active":"2024-09-19T09:00:47.430365+0000","last_peered":"2024-09-19T09:00:47.430365+0000","last_clean":"2024-09-19T09:00:47.430365+0000","last_became_active":"2024-09-19T09:00:37.081508+0000","last_became_peered":"2024-09-19T09:00:37.081508+0000","last_unstale":"2024-09-19T09:00:47.430365+0000","last_undegraded":"2024-09-19T09:00:47.430365+0000","last_fullsized":"2024-09-19T09:00:47.430365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:53.502987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133974+0000","last_change":"2024-09-19T09:00:37.074201+0000","last_active":"2024-09-19T09:00:47.133974+0000","last_peered":"2024-09-19T09:00:47.133974+0000","last_clean":"2024-09-19T09:00:47.133974+0000","last_became_active":"2024-09-19T09:00:37.073833+0000","last_became_peered":"2024-09-19T09:00:37.073833+0000","last_unstale":"2024-09-19T09:00:47.133974+0000","last_undegraded":"2024-09-19T09:00:47.133974+0000","last_fullsized":"2024-09-19T09:00:47.133974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:45.016566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430134+0000","last_change":"2024-09-19T09:00:37.078436+0000","last_active":"2024-09-19T09:00:47.430134+0000","last_peered":"2024-09-19T09:00:47.430134+0000","last_clean":"2024-09-19T09:00:47.430134+0000","last_became_active":"2024-09-19T09:00:37.077648+0000","last_became_peered":"2024-09-19T09:00:37.077648+0000","last_unstale":"2024-09-19T09:00:47.430134+0000","last_undegraded":"2024-09-19T09:00:47.430134+0000","last_fullsized":"2024-09-19T09:00:47.430134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.258856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431031+0000","last_change":"2024-09-19T09:00:44.131018+0000","last_active":"2024-09-19T09:00:47.431031+0000","last_peered":"2024-09-19T09:00:47.431031+0000","last_clean":"2024-09-19T09:00:47.431031+0000","last_became_active":"2024-09-19T09:00:44.130698+0000","last_became_peered":"2024-09-19T09:00:44.130698+0000","last_unstale":"2024-09-19T09:00:47.431031+0000","last_undegraded":"2024-09-19T09:00:47.431031+0000","last_fullsized":"2024-09-19T09:00:47.431031+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:57.552728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133203+0000","last_change":"2024-09-19T09:00:37.085490+0000","last_active":"2024-09-19T09:00:47.133203+0000","last_peered":"2024-09-19T09:00:47.133203+0000","last_clean":"2024-09-19T09:00:47.133203+0000","last_became_active":"2024-09-19T09:00:37.085171+0000","last_became_peered":"2024-09-19T09:00:37.085171+0000","last_unstale":"2024-09-19T09:00:47.133203+0000","last_undegraded":"2024-09-19T09:00:47.133203+0000","last_fullsized":"2024-09-19T09:00:47.133203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:48.252031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133302+0000","last_change":"2024-09-19T09:00:37.071638+0000","last_active":"2024-09-19T09:00:47.133302+0000","last_peered":"2024-09-19T09:00:47.133302+0000","last_clean":"2024-09-19T09:00:47.133302+0000","last_became_active":"2024-09-19T09:00:37.071303+0000","last_became_peered":"2024-09-19T09:00:37.071303+0000","last_unstale":"2024-09-19T09:00:47.133302+0000","last_undegraded":"2024-09-19T09:00:47.133302+0000","last_fullsized":"2024-09-19T09:00:47.133302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:41.590831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431650+0000","last_change":"2024-09-19T09:00:37.083761+0000","last_active":"2024-09-19T09:00:47.431650+0000","last_peered":"2024-09-19T09:00:47.431650+0000","last_clean":"2024-09-19T09:00:47.431650+0000","last_became_active":"2024-09-19T09:00:37.079681+0000","last_became_peered":"2024-09-19T09:00:37.079681+0000","last_unstale":"2024-09-19T09:00:47.431650+0000","last_undegraded":"2024-09-19T09:00:47.431650+0000","last_fullsized":"2024-09-19T09:00:47.431650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:35.104720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50553,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":230,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":151659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":487219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776156,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1117661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939680,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":487037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201318,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":483207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430251,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708240,"statfs":{"total":95995035648,"available":95957237760,"internally_reserved":0,"allocated":1605632,"data_stored":1080211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593777,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":482934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36924,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708228,"statfs":{"total":95995035648,"available":95957225472,"internally_reserved":0,"allocated":1617920,"data_stored":1079103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018938,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":488178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247870,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":482249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476805,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":525966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":527309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":483997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":44147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":45474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:01:31.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:01:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 -- 172.21.15.83:0/370946917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c106a80 msgr2=0x7f683c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 --2- 172.21.15.83:0/370946917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c106a80 0x7f683c106e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f682c009cd0 tx=0x7f682c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 -- 172.21.15.83:0/370946917 shutdown_connections 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 --2- 172.21.15.83:0/370946917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 0x7f683c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 --2- 172.21.15.83:0/370946917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c100a80 0x7f683c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 --2- 172.21.15.83:0/370946917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c106a80 0x7f683c106e60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 -- 172.21.15.83:0/370946917 >> 172.21.15.83:0/370946917 conn(0x7f683c0fc7a0 msgr2=0x7f683c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 -- 172.21.15.83:0/370946917 shutdown_connections 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 -- 172.21.15.83:0/370946917 wait complete. 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 Processor -- start 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.071+0000 7f6842096640 1 -- start start 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 0x7f683c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 0x7f683c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c106a80 0x7f683c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f683c110dd0 con 0x7f683c100a80 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f683c110c50 con 0x7f683c106a80 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f683c110f50 con 0x7f683c101420 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 0x7f683c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 0x7f683c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34336/0 (socket says 172.21.15.83:34336) 2024-09-19T09:01:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 -- 172.21.15.83:0/1425680025 learned_addr learned my addr 172.21.15.83:0/1425680025 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683affd640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 0x7f683c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683bfff640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c106a80 0x7f683c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 -- 172.21.15.83:0/1425680025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 msgr2=0x7f683c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 0x7f683c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 -- 172.21.15.83:0/1425680025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c106a80 msgr2=0x7f683c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c106a80 0x7f683c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 -- 172.21.15.83:0/1425680025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c19d490 con 0x7f683c100a80 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683affd640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 0x7f683c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f683b7fe640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 0x7f683c1984e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f682c006010 tx=0x7f682c003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c004450 con 0x7f683c100a80 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f682c0045f0 con 0x7f683c100a80 2024-09-19T09:01:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0466e0 con 0x7f683c100a80 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.072+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c19d720 con 0x7f683c100a80 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.073+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c1a5060 con 0x7f683c100a80 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.073+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c1021c0 con 0x7f683c100a80 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.074+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f682c046880 con 0x7f683c100a80 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.075+0000 7f6838ff9640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f68280a32d0 0x7f68280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.075+0000 7f683affd640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f68280a32d0 0x7f68280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.075+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f682c02e030 con 0x7f683c100a80 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.076+0000 7f683affd640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f68280a32d0 0x7f68280a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f683c105360 tx=0x7f6824008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.079+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f682c04b060 con 0x7f683c100a80 2024-09-19T09:01:32.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.247+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f683c10a070 con 0x7f68280a32d0 2024-09-19T09:01:32.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:32 smithi083 ceph-mon[30926]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:01:32.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:32 smithi083 ceph-mon[30926]: pgmap v311: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 19 op/s 2024-09-19T09:01:32.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.255+0000 7f6838ff9640 1 -- 172.21.15.83:0/1425680025 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340404 (secure 0 0 0) 0x7f6824009140 con 0x7f68280a32d0 2024-09-19T09:01:32.260 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f68280a32d0 msgr2=0x7f68280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f68280a32d0 0x7f68280a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f683c105360 tx=0x7f6824008040 comp rx=0 tx=0).stop 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 msgr2=0x7f683c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 0x7f683c1984e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f682c006010 tx=0x7f682c003c70 comp rx=0 tx=0).stop 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 shutdown_connections 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f68280a32d0 0x7f68280a5790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c106a80 0x7f683c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f683c101420 0x7f683c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 --2- 172.21.15.83:0/1425680025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f683c100a80 0x7f683c1984e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:32.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 >> 172.21.15.83:0/1425680025 conn(0x7f683c0fc7a0 msgr2=0x7f683c06ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:32.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 shutdown_connections 2024-09-19T09:01:32.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:32.258+0000 7f6842096640 1 -- 172.21.15.83:0/1425680025 wait complete. 2024-09-19T09:01:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:32 smithi184 ceph-mon[35007]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:01:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:32 smithi184 ceph-mon[35007]: pgmap v311: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 19 op/s 2024-09-19T09:01:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:32 smithi122 ceph-mon[34247]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:01:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:32 smithi122 ceph-mon[34247]: pgmap v311: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 19 op/s 2024-09-19T09:01:32.983 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-19T09:01:30.924907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650218,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":313,"num_read_kb":277,"num_write":424,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379596,"kb_used_data":13708,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562228,"statfs":{"total":1151940427776,"available":1151551721472,"internally_reserved":0,"allocated":14036992,"data_stored":7746422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50934,"num_objects":25,"num_object_clones":0,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":144,"num_read_kb":133,"num_write":87,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003340"},"pg_stats":[{"pgid":"2.1f","version":"87'13","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:27.215785+0000","last_change":"2024-09-19T09:00:35.055195+0000","last_active":"2024-09-19T09:01:27.215785+0000","last_peered":"2024-09-19T09:01:27.215785+0000","last_clean":"2024-09-19T09:01:27.215785+0000","last_became_active":"2024-09-19T09:00:35.054878+0000","last_became_peered":"2024-09-19T09:00:35.054878+0000","last_unstale":"2024-09-19T09:01:27.215785+0000","last_undegraded":"2024-09-19T09:01:27.215785+0000","last_fullsized":"2024-09-19T09:01:27.215785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:40.719595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430908+0000","last_change":"2024-09-19T09:00:37.077470+0000","last_active":"2024-09-19T09:00:47.430908+0000","last_peered":"2024-09-19T09:00:47.430908+0000","last_clean":"2024-09-19T09:00:47.430908+0000","last_became_active":"2024-09-19T09:00:37.077158+0000","last_became_peered":"2024-09-19T09:00:37.077158+0000","last_unstale":"2024-09-19T09:00:47.430908+0000","last_undegraded":"2024-09-19T09:00:47.430908+0000","last_fullsized":"2024-09-19T09:00:47.430908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:00.350496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133878+0000","last_change":"2024-09-19T09:00:44.135294+0000","last_active":"2024-09-19T09:00:47.133878+0000","last_peered":"2024-09-19T09:00:47.133878+0000","last_clean":"2024-09-19T09:00:47.133878+0000","last_became_active":"2024-09-19T09:00:44.134844+0000","last_became_peered":"2024-09-19T09:00:44.134844+0000","last_unstale":"2024-09-19T09:00:47.133878+0000","last_undegraded":"2024-09-19T09:00:47.133878+0000","last_fullsized":"2024-09-19T09:00:47.133878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:06.231954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431232+0000","last_change":"2024-09-19T09:00:35.499941+0000","last_active":"2024-09-19T09:00:47.431232+0000","last_peered":"2024-09-19T09:00:47.431232+0000","last_clean":"2024-09-19T09:00:47.431232+0000","last_became_active":"2024-09-19T09:00:35.499463+0000","last_became_peered":"2024-09-19T09:00:35.499463+0000","last_unstale":"2024-09-19T09:00:47.431232+0000","last_undegraded":"2024-09-19T09:00:47.431232+0000","last_fullsized":"2024-09-19T09:00:47.431232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:15.603127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133565+0000","last_change":"2024-09-19T09:00:37.078318+0000","last_active":"2024-09-19T09:00:47.133565+0000","last_peered":"2024-09-19T09:00:47.133565+0000","last_clean":"2024-09-19T09:00:47.133565+0000","last_became_active":"2024-09-19T09:00:37.078037+0000","last_became_peered":"2024-09-19T09:00:37.078037+0000","last_unstale":"2024-09-19T09:00:47.133565+0000","last_undegraded":"2024-09-19T09:00:47.133565+0000","last_fullsized":"2024-09-19T09:00:47.133565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:41.860274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429810+0000","last_change":"2024-09-19T09:00:44.132012+0000","last_active":"2024-09-19T09:00:47.429810+0000","last_peered":"2024-09-19T09:00:47.429810+0000","last_clean":"2024-09-19T09:00:47.429810+0000","last_became_active":"2024-09-19T09:00:44.131238+0000","last_became_peered":"2024-09-19T09:00:44.131238+0000","last_unstale":"2024-09-19T09:00:47.429810+0000","last_undegraded":"2024-09-19T09:00:47.429810+0000","last_fullsized":"2024-09-19T09:00:47.429810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:07.931510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.199392+0000","last_change":"2024-09-19T09:00:35.059882+0000","last_active":"2024-09-19T09:01:15.199392+0000","last_peered":"2024-09-19T09:01:15.199392+0000","last_clean":"2024-09-19T09:01:15.199392+0000","last_became_active":"2024-09-19T09:00:35.059467+0000","last_became_peered":"2024-09-19T09:00:35.059467+0000","last_unstale":"2024-09-19T09:01:15.199392+0000","last_undegraded":"2024-09-19T09:01:15.199392+0000","last_fullsized":"2024-09-19T09:01:15.199392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:59.309282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430401+0000","last_change":"2024-09-19T09:00:37.078097+0000","last_active":"2024-09-19T09:00:47.430401+0000","last_peered":"2024-09-19T09:00:47.430401+0000","last_clean":"2024-09-19T09:00:47.430401+0000","last_became_active":"2024-09-19T09:00:37.077770+0000","last_became_peered":"2024-09-19T09:00:37.077770+0000","last_unstale":"2024-09-19T09:00:47.430401+0000","last_undegraded":"2024-09-19T09:00:47.430401+0000","last_fullsized":"2024-09-19T09:00:47.430401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:57.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431775+0000","last_change":"2024-09-19T09:00:44.128702+0000","last_active":"2024-09-19T09:00:47.431775+0000","last_peered":"2024-09-19T09:00:47.431775+0000","last_clean":"2024-09-19T09:00:47.431775+0000","last_became_active":"2024-09-19T09:00:44.128324+0000","last_became_peered":"2024-09-19T09:00:44.128324+0000","last_unstale":"2024-09-19T09:00:47.431775+0000","last_undegraded":"2024-09-19T09:00:47.431775+0000","last_fullsized":"2024-09-19T09:00:47.431775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:43.165912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198965+0000","last_change":"2024-09-19T09:00:35.057840+0000","last_active":"2024-09-19T09:01:15.198965+0000","last_peered":"2024-09-19T09:01:15.198965+0000","last_clean":"2024-09-19T09:01:15.198965+0000","last_became_active":"2024-09-19T09:00:35.057458+0000","last_became_peered":"2024-09-19T09:00:35.057458+0000","last_unstale":"2024-09-19T09:01:15.198965+0000","last_undegraded":"2024-09-19T09:01:15.198965+0000","last_fullsized":"2024-09-19T09:01:15.198965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:40.393892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431079+0000","last_change":"2024-09-19T09:00:37.082885+0000","last_active":"2024-09-19T09:00:47.431079+0000","last_peered":"2024-09-19T09:00:47.431079+0000","last_clean":"2024-09-19T09:00:47.431079+0000","last_became_active":"2024-09-19T09:00:37.082494+0000","last_became_peered":"2024-09-19T09:00:37.082494+0000","last_unstale":"2024-09-19T09:00:47.431079+0000","last_undegraded":"2024-09-19T09:00:47.431079+0000","last_fullsized":"2024-09-19T09:00:47.431079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:47.795093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430091+0000","last_change":"2024-09-19T09:00:44.126516+0000","last_active":"2024-09-19T09:00:47.430091+0000","last_peered":"2024-09-19T09:00:47.430091+0000","last_clean":"2024-09-19T09:00:47.430091+0000","last_became_active":"2024-09-19T09:00:44.125973+0000","last_became_peered":"2024-09-19T09:00:44.125973+0000","last_unstale":"2024-09-19T09:00:47.430091+0000","last_undegraded":"2024-09-19T09:00:47.430091+0000","last_fullsized":"2024-09-19T09:00:47.430091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:09.934473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430871+0000","last_change":"2024-09-19T09:00:37.079297+0000","last_active":"2024-09-19T09:00:47.430871+0000","last_peered":"2024-09-19T09:00:47.430871+0000","last_clean":"2024-09-19T09:00:47.430871+0000","last_became_active":"2024-09-19T09:00:37.078949+0000","last_became_peered":"2024-09-19T09:00:37.078949+0000","last_unstale":"2024-09-19T09:00:47.430871+0000","last_undegraded":"2024-09-19T09:00:47.430871+0000","last_fullsized":"2024-09-19T09:00:47.430871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:33.823014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:13.021101+0000","last_change":"2024-09-19T09:00:35.058467+0000","last_active":"2024-09-19T09:01:13.021101+0000","last_peered":"2024-09-19T09:01:13.021101+0000","last_clean":"2024-09-19T09:01:13.021101+0000","last_became_active":"2024-09-19T09:00:35.058103+0000","last_became_peered":"2024-09-19T09:00:35.058103+0000","last_unstale":"2024-09-19T09:01:13.021101+0000","last_undegraded":"2024-09-19T09:01:13.021101+0000","last_fullsized":"2024-09-19T09:01:13.021101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:29.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430971+0000","last_change":"2024-09-19T09:00:44.129381+0000","last_active":"2024-09-19T09:00:47.430971+0000","last_peered":"2024-09-19T09:00:47.430971+0000","last_clean":"2024-09-19T09:00:47.430971+0000","last_became_active":"2024-09-19T09:00:44.128984+0000","last_became_peered":"2024-09-19T09:00:44.128984+0000","last_unstale":"2024-09-19T09:00:47.430971+0000","last_undegraded":"2024-09-19T09:00:47.430971+0000","last_fullsized":"2024-09-19T09:00:47.430971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:28.427607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429745+0000","last_change":"2024-09-19T09:00:37.066684+0000","last_active":"2024-09-19T09:00:47.429745+0000","last_peered":"2024-09-19T09:00:47.429745+0000","last_clean":"2024-09-19T09:00:47.429745+0000","last_became_active":"2024-09-19T09:00:37.066401+0000","last_became_peered":"2024-09-19T09:00:37.066401+0000","last_unstale":"2024-09-19T09:00:47.429745+0000","last_undegraded":"2024-09-19T09:00:47.429745+0000","last_fullsized":"2024-09-19T09:00:47.429745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:54.344499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.032923+0000","last_change":"2024-09-19T09:00:44.123394+0000","last_active":"2024-09-19T09:01:15.032923+0000","last_peered":"2024-09-19T09:01:15.032923+0000","last_clean":"2024-09-19T09:01:15.032923+0000","last_became_active":"2024-09-19T09:00:44.122905+0000","last_became_peered":"2024-09-19T09:00:44.122905+0000","last_unstale":"2024-09-19T09:01:15.032923+0000","last_undegraded":"2024-09-19T09:01:15.032923+0000","last_fullsized":"2024-09-19T09:01:15.032923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.852333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431046+0000","last_change":"2024-09-19T09:00:44.134493+0000","last_active":"2024-09-19T09:00:47.431046+0000","last_peered":"2024-09-19T09:00:47.431046+0000","last_clean":"2024-09-19T09:00:47.431046+0000","last_became_active":"2024-09-19T09:00:44.133991+0000","last_became_peered":"2024-09-19T09:00:44.133991+0000","last_unstale":"2024-09-19T09:00:47.431046+0000","last_undegraded":"2024-09-19T09:00:47.431046+0000","last_fullsized":"2024-09-19T09:00:47.431046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:08.981672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431299+0000","last_change":"2024-09-19T09:00:37.077400+0000","last_active":"2024-09-19T09:00:47.431299+0000","last_peered":"2024-09-19T09:00:47.431299+0000","last_clean":"2024-09-19T09:00:47.431299+0000","last_became_active":"2024-09-19T09:00:37.077065+0000","last_became_peered":"2024-09-19T09:00:37.077065+0000","last_unstale":"2024-09-19T09:00:47.431299+0000","last_undegraded":"2024-09-19T09:00:47.431299+0000","last_fullsized":"2024-09-19T09:00:47.431299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:59.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198489+0000","last_change":"2024-09-19T09:00:35.053074+0000","last_active":"2024-09-19T09:01:15.198489+0000","last_peered":"2024-09-19T09:01:15.198489+0000","last_clean":"2024-09-19T09:01:15.198489+0000","last_became_active":"2024-09-19T09:00:35.052574+0000","last_became_peered":"2024-09-19T09:00:35.052574+0000","last_unstale":"2024-09-19T09:01:15.198489+0000","last_undegraded":"2024-09-19T09:01:15.198489+0000","last_fullsized":"2024-09-19T09:01:15.198489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:25.762622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430820+0000","last_change":"2024-09-19T09:00:44.132931+0000","last_active":"2024-09-19T09:00:47.430820+0000","last_peered":"2024-09-19T09:00:47.430820+0000","last_clean":"2024-09-19T09:00:47.430820+0000","last_became_active":"2024-09-19T09:00:44.132397+0000","last_became_peered":"2024-09-19T09:00:44.132397+0000","last_unstale":"2024-09-19T09:00:47.430820+0000","last_undegraded":"2024-09-19T09:00:47.430820+0000","last_fullsized":"2024-09-19T09:00:47.430820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.962417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429715+0000","last_change":"2024-09-19T09:00:37.077233+0000","last_active":"2024-09-19T09:00:47.429715+0000","last_peered":"2024-09-19T09:00:47.429715+0000","last_clean":"2024-09-19T09:00:47.429715+0000","last_became_active":"2024-09-19T09:00:37.076855+0000","last_became_peered":"2024-09-19T09:00:37.076855+0000","last_unstale":"2024-09-19T09:00:47.429715+0000","last_undegraded":"2024-09-19T09:00:47.429715+0000","last_fullsized":"2024-09-19T09:00:47.429715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:32.794488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:13.022993+0000","last_change":"2024-09-19T09:00:35.501157+0000","last_active":"2024-09-19T09:01:13.022993+0000","last_peered":"2024-09-19T09:01:13.022993+0000","last_clean":"2024-09-19T09:01:13.022993+0000","last_became_active":"2024-09-19T09:00:35.500869+0000","last_became_peered":"2024-09-19T09:00:35.500869+0000","last_unstale":"2024-09-19T09:01:13.022993+0000","last_undegraded":"2024-09-19T09:01:13.022993+0000","last_fullsized":"2024-09-19T09:01:13.022993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:44.333496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430993+0000","last_change":"2024-09-19T09:00:44.131479+0000","last_active":"2024-09-19T09:00:47.430993+0000","last_peered":"2024-09-19T09:00:47.430993+0000","last_clean":"2024-09-19T09:00:47.430993+0000","last_became_active":"2024-09-19T09:00:44.131058+0000","last_became_peered":"2024-09-19T09:00:44.131058+0000","last_unstale":"2024-09-19T09:00:47.430993+0000","last_undegraded":"2024-09-19T09:00:47.430993+0000","last_fullsized":"2024-09-19T09:00:47.430993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.980874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133389+0000","last_change":"2024-09-19T09:00:37.076590+0000","last_active":"2024-09-19T09:00:47.133389+0000","last_peered":"2024-09-19T09:00:47.133389+0000","last_clean":"2024-09-19T09:00:47.133389+0000","last_became_active":"2024-09-19T09:00:37.076287+0000","last_became_peered":"2024-09-19T09:00:37.076287+0000","last_unstale":"2024-09-19T09:00:47.133389+0000","last_undegraded":"2024-09-19T09:00:47.133389+0000","last_fullsized":"2024-09-19T09:00:47.133389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:22.237571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198709+0000","last_change":"2024-09-19T09:00:35.733174+0000","last_active":"2024-09-19T09:01:15.198709+0000","last_peered":"2024-09-19T09:01:15.198709+0000","last_clean":"2024-09-19T09:01:15.198709+0000","last_became_active":"2024-09-19T09:00:35.732824+0000","last_became_peered":"2024-09-19T09:00:35.732824+0000","last_unstale":"2024-09-19T09:01:15.198709+0000","last_undegraded":"2024-09-19T09:01:15.198709+0000","last_fullsized":"2024-09-19T09:01:15.198709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:15.143792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134011+0000","last_change":"2024-09-19T09:00:44.137095+0000","last_active":"2024-09-19T09:00:47.134011+0000","last_peered":"2024-09-19T09:00:47.134011+0000","last_clean":"2024-09-19T09:00:47.134011+0000","last_became_active":"2024-09-19T09:00:44.136697+0000","last_became_peered":"2024-09-19T09:00:44.136697+0000","last_unstale":"2024-09-19T09:00:47.134011+0000","last_undegraded":"2024-09-19T09:00:47.134011+0000","last_fullsized":"2024-09-19T09:00:47.134011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:14.316016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430286+0000","last_change":"2024-09-19T09:00:37.074155+0000","last_active":"2024-09-19T09:00:47.430286+0000","last_peered":"2024-09-19T09:00:47.430286+0000","last_clean":"2024-09-19T09:00:47.430286+0000","last_became_active":"2024-09-19T09:00:37.073819+0000","last_became_peered":"2024-09-19T09:00:37.073819+0000","last_unstale":"2024-09-19T09:00:47.430286+0000","last_undegraded":"2024-09-19T09:00:47.430286+0000","last_fullsized":"2024-09-19T09:00:47.430286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:18.598437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'13","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:26.072312+0000","last_change":"2024-09-19T09:00:35.055231+0000","last_active":"2024-09-19T09:01:26.072312+0000","last_peered":"2024-09-19T09:01:26.072312+0000","last_clean":"2024-09-19T09:01:26.072312+0000","last_became_active":"2024-09-19T09:00:35.054915+0000","last_became_peered":"2024-09-19T09:00:35.054915+0000","last_unstale":"2024-09-19T09:01:26.072312+0000","last_undegraded":"2024-09-19T09:01:26.072312+0000","last_fullsized":"2024-09-19T09:01:26.072312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:27.730738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429646+0000","last_change":"2024-09-19T09:00:44.134600+0000","last_active":"2024-09-19T09:00:47.429646+0000","last_peered":"2024-09-19T09:00:47.429646+0000","last_clean":"2024-09-19T09:00:47.429646+0000","last_became_active":"2024-09-19T09:00:44.134274+0000","last_became_peered":"2024-09-19T09:00:44.134274+0000","last_unstale":"2024-09-19T09:00:47.429646+0000","last_undegraded":"2024-09-19T09:00:47.429646+0000","last_fullsized":"2024-09-19T09:00:47.429646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:07.172654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430099+0000","last_change":"2024-09-19T09:00:37.075695+0000","last_active":"2024-09-19T09:00:47.430099+0000","last_peered":"2024-09-19T09:00:47.430099+0000","last_clean":"2024-09-19T09:00:47.430099+0000","last_became_active":"2024-09-19T09:00:37.075395+0000","last_became_peered":"2024-09-19T09:00:37.075395+0000","last_unstale":"2024-09-19T09:00:47.430099+0000","last_undegraded":"2024-09-19T09:00:47.430099+0000","last_fullsized":"2024-09-19T09:00:47.430099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.105953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.189864+0000","last_change":"2024-09-19T09:00:35.502029+0000","last_active":"2024-09-19T09:01:15.189864+0000","last_peered":"2024-09-19T09:01:15.189864+0000","last_clean":"2024-09-19T09:01:15.189864+0000","last_became_active":"2024-09-19T09:00:35.501535+0000","last_became_peered":"2024-09-19T09:00:35.501535+0000","last_unstale":"2024-09-19T09:01:15.189864+0000","last_undegraded":"2024-09-19T09:01:15.189864+0000","last_fullsized":"2024-09-19T09:01:15.189864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:12.104470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430493+0000","last_change":"2024-09-19T09:00:44.134361+0000","last_active":"2024-09-19T09:00:47.430493+0000","last_peered":"2024-09-19T09:00:47.430493+0000","last_clean":"2024-09-19T09:00:47.430493+0000","last_became_active":"2024-09-19T09:00:44.133859+0000","last_became_peered":"2024-09-19T09:00:44.133859+0000","last_unstale":"2024-09-19T09:00:47.430493+0000","last_undegraded":"2024-09-19T09:00:47.430493+0000","last_fullsized":"2024-09-19T09:00:47.430493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:29.075555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133974+0000","last_change":"2024-09-19T09:00:37.067259+0000","last_active":"2024-09-19T09:00:47.133974+0000","last_peered":"2024-09-19T09:00:47.133974+0000","last_clean":"2024-09-19T09:00:47.133974+0000","last_became_active":"2024-09-19T09:00:37.066932+0000","last_became_peered":"2024-09-19T09:00:37.066932+0000","last_unstale":"2024-09-19T09:00:47.133974+0000","last_undegraded":"2024-09-19T09:00:47.133974+0000","last_fullsized":"2024-09-19T09:00:47.133974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:09.205551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431243+0000","last_change":"2024-09-19T09:00:35.501139+0000","last_active":"2024-09-19T09:00:47.431243+0000","last_peered":"2024-09-19T09:00:47.431243+0000","last_clean":"2024-09-19T09:00:47.431243+0000","last_became_active":"2024-09-19T09:00:35.500790+0000","last_became_peered":"2024-09-19T09:00:35.500790+0000","last_unstale":"2024-09-19T09:00:47.431243+0000","last_undegraded":"2024-09-19T09:00:47.431243+0000","last_fullsized":"2024-09-19T09:00:47.431243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:51.811772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429893+0000","last_change":"2024-09-19T09:00:44.130524+0000","last_active":"2024-09-19T09:00:47.429893+0000","last_peered":"2024-09-19T09:00:47.429893+0000","last_clean":"2024-09-19T09:00:47.429893+0000","last_became_active":"2024-09-19T09:00:44.130002+0000","last_became_peered":"2024-09-19T09:00:44.130002+0000","last_unstale":"2024-09-19T09:00:47.429893+0000","last_undegraded":"2024-09-19T09:00:47.429893+0000","last_fullsized":"2024-09-19T09:00:47.429893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:35.060388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134117+0000","last_change":"2024-09-19T09:00:44.128716+0000","last_active":"2024-09-19T09:00:47.134117+0000","last_peered":"2024-09-19T09:00:47.134117+0000","last_clean":"2024-09-19T09:00:47.134117+0000","last_became_active":"2024-09-19T09:00:44.128295+0000","last_became_peered":"2024-09-19T09:00:44.128295+0000","last_unstale":"2024-09-19T09:00:47.134117+0000","last_undegraded":"2024-09-19T09:00:47.134117+0000","last_fullsized":"2024-09-19T09:00:47.134117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:55.576207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:27.216256+0000","last_change":"2024-09-19T09:00:35.057111+0000","last_active":"2024-09-19T09:01:27.216256+0000","last_peered":"2024-09-19T09:01:27.216256+0000","last_clean":"2024-09-19T09:01:27.216256+0000","last_became_active":"2024-09-19T09:00:35.056761+0000","last_became_peered":"2024-09-19T09:00:35.056761+0000","last_unstale":"2024-09-19T09:01:27.216256+0000","last_undegraded":"2024-09-19T09:01:27.216256+0000","last_fullsized":"2024-09-19T09:01:27.216256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:22.222798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430006+0000","last_change":"2024-09-19T09:00:44.130871+0000","last_active":"2024-09-19T09:00:47.430006+0000","last_peered":"2024-09-19T09:00:47.430006+0000","last_clean":"2024-09-19T09:00:47.430006+0000","last_became_active":"2024-09-19T09:00:44.130481+0000","last_became_peered":"2024-09-19T09:00:44.130481+0000","last_unstale":"2024-09-19T09:00:47.430006+0000","last_undegraded":"2024-09-19T09:00:47.430006+0000","last_fullsized":"2024-09-19T09:00:47.430006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:47.312776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430201+0000","last_change":"2024-09-19T09:00:37.077325+0000","last_active":"2024-09-19T09:00:47.430201+0000","last_peered":"2024-09-19T09:00:47.430201+0000","last_clean":"2024-09-19T09:00:47.430201+0000","last_became_active":"2024-09-19T09:00:37.076979+0000","last_became_peered":"2024-09-19T09:00:37.076979+0000","last_unstale":"2024-09-19T09:00:47.430201+0000","last_undegraded":"2024-09-19T09:00:47.430201+0000","last_fullsized":"2024-09-19T09:00:47.430201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:25.367304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:27.216230+0000","last_change":"2024-09-19T09:00:35.499862+0000","last_active":"2024-09-19T09:01:27.216230+0000","last_peered":"2024-09-19T09:01:27.216230+0000","last_clean":"2024-09-19T09:01:27.216230+0000","last_became_active":"2024-09-19T09:00:35.499534+0000","last_became_peered":"2024-09-19T09:00:35.499534+0000","last_unstale":"2024-09-19T09:01:27.216230+0000","last_undegraded":"2024-09-19T09:01:27.216230+0000","last_fullsized":"2024-09-19T09:01:27.216230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:21.008440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430798+0000","last_change":"2024-09-19T09:00:44.135298+0000","last_active":"2024-09-19T09:00:47.430798+0000","last_peered":"2024-09-19T09:00:47.430798+0000","last_clean":"2024-09-19T09:00:47.430798+0000","last_became_active":"2024-09-19T09:00:44.134899+0000","last_became_peered":"2024-09-19T09:00:44.134899+0000","last_unstale":"2024-09-19T09:00:47.430798+0000","last_undegraded":"2024-09-19T09:00:47.430798+0000","last_fullsized":"2024-09-19T09:00:47.430798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430226+0000","last_change":"2024-09-19T09:00:37.076195+0000","last_active":"2024-09-19T09:00:47.430226+0000","last_peered":"2024-09-19T09:00:47.430226+0000","last_clean":"2024-09-19T09:00:47.430226+0000","last_became_active":"2024-09-19T09:00:37.075906+0000","last_became_peered":"2024-09-19T09:00:37.075906+0000","last_unstale":"2024-09-19T09:00:47.430226+0000","last_undegraded":"2024-09-19T09:00:47.430226+0000","last_fullsized":"2024-09-19T09:00:47.430226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:47.724434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:14.027077+0000","last_change":"2024-09-19T09:00:35.059862+0000","last_active":"2024-09-19T09:01:14.027077+0000","last_peered":"2024-09-19T09:01:14.027077+0000","last_clean":"2024-09-19T09:01:14.027077+0000","last_became_active":"2024-09-19T09:00:35.058944+0000","last_became_peered":"2024-09-19T09:00:35.058944+0000","last_unstale":"2024-09-19T09:01:14.027077+0000","last_undegraded":"2024-09-19T09:01:14.027077+0000","last_fullsized":"2024-09-19T09:01:14.027077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:00.233367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431275+0000","last_change":"2024-09-19T09:00:44.133451+0000","last_active":"2024-09-19T09:00:47.431275+0000","last_peered":"2024-09-19T09:00:47.431275+0000","last_clean":"2024-09-19T09:00:47.431275+0000","last_became_active":"2024-09-19T09:00:44.133069+0000","last_became_peered":"2024-09-19T09:00:44.133069+0000","last_unstale":"2024-09-19T09:00:47.431275+0000","last_undegraded":"2024-09-19T09:00:47.431275+0000","last_fullsized":"2024-09-19T09:00:47.431275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:22.890861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430334+0000","last_change":"2024-09-19T09:00:44.132394+0000","last_active":"2024-09-19T09:00:47.430334+0000","last_peered":"2024-09-19T09:00:47.430334+0000","last_clean":"2024-09-19T09:00:47.430334+0000","last_became_active":"2024-09-19T09:00:44.132050+0000","last_became_peered":"2024-09-19T09:00:44.132050+0000","last_unstale":"2024-09-19T09:00:47.430334+0000","last_undegraded":"2024-09-19T09:00:47.430334+0000","last_fullsized":"2024-09-19T09:00:47.430334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:12.963885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198501+0000","last_change":"2024-09-19T09:00:35.055179+0000","last_active":"2024-09-19T09:01:15.198501+0000","last_peered":"2024-09-19T09:01:15.198501+0000","last_clean":"2024-09-19T09:01:15.198501+0000","last_became_active":"2024-09-19T09:00:35.054788+0000","last_became_peered":"2024-09-19T09:00:35.054788+0000","last_unstale":"2024-09-19T09:01:15.198501+0000","last_undegraded":"2024-09-19T09:01:15.198501+0000","last_fullsized":"2024-09-19T09:01:15.198501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:50.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430602+0000","last_change":"2024-09-19T08:59:22.943778+0000","last_active":"2024-09-19T09:00:47.430602+0000","last_peered":"2024-09-19T09:00:47.430602+0000","last_clean":"2024-09-19T09:00:47.430602+0000","last_became_active":"2024-09-19T08:59:22.943357+0000","last_became_peered":"2024-09-19T08:59:22.943357+0000","last_unstale":"2024-09-19T09:00:47.430602+0000","last_undegraded":"2024-09-19T09:00:47.430602+0000","last_fullsized":"2024-09-19T09:00:47.430602+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_clean_scrub_stamp":"2024-09-19T08:55:57.183363+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:02.301026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431525+0000","last_change":"2024-09-19T09:00:44.135446+0000","last_active":"2024-09-19T09:00:47.431525+0000","last_peered":"2024-09-19T09:00:47.431525+0000","last_clean":"2024-09-19T09:00:47.431525+0000","last_became_active":"2024-09-19T09:00:44.135030+0000","last_became_peered":"2024-09-19T09:00:44.135030+0000","last_unstale":"2024-09-19T09:00:47.431525+0000","last_undegraded":"2024-09-19T09:00:47.431525+0000","last_fullsized":"2024-09-19T09:00:47.431525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:13.588934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431589+0000","last_change":"2024-09-19T09:00:37.079569+0000","last_active":"2024-09-19T09:00:47.431589+0000","last_peered":"2024-09-19T09:00:47.431589+0000","last_clean":"2024-09-19T09:00:47.431589+0000","last_became_active":"2024-09-19T09:00:37.079089+0000","last_became_peered":"2024-09-19T09:00:37.079089+0000","last_unstale":"2024-09-19T09:00:47.431589+0000","last_undegraded":"2024-09-19T09:00:47.431589+0000","last_fullsized":"2024-09-19T09:00:47.431589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:56.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:26.206893+0000","last_change":"2024-09-19T09:00:44.125607+0000","last_active":"2024-09-19T09:01:26.206893+0000","last_peered":"2024-09-19T09:01:26.206893+0000","last_clean":"2024-09-19T09:01:26.206893+0000","last_became_active":"2024-09-19T09:00:44.125236+0000","last_became_peered":"2024-09-19T09:00:44.125236+0000","last_unstale":"2024-09-19T09:01:26.206893+0000","last_undegraded":"2024-09-19T09:01:26.206893+0000","last_fullsized":"2024-09-19T09:01:26.206893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:21.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429920+0000","last_change":"2024-09-19T09:00:44.136886+0000","last_active":"2024-09-19T09:00:47.429920+0000","last_peered":"2024-09-19T09:00:47.429920+0000","last_clean":"2024-09-19T09:00:47.429920+0000","last_became_active":"2024-09-19T09:00:44.136394+0000","last_became_peered":"2024-09-19T09:00:44.136394+0000","last_unstale":"2024-09-19T09:00:47.429920+0000","last_undegraded":"2024-09-19T09:00:47.429920+0000","last_fullsized":"2024-09-19T09:00:47.429920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.680203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431246+0000","last_change":"2024-09-19T09:00:37.081017+0000","last_active":"2024-09-19T09:00:47.431246+0000","last_peered":"2024-09-19T09:00:47.431246+0000","last_clean":"2024-09-19T09:00:47.431246+0000","last_became_active":"2024-09-19T09:00:37.080674+0000","last_became_peered":"2024-09-19T09:00:37.080674+0000","last_unstale":"2024-09-19T09:00:47.431246+0000","last_undegraded":"2024-09-19T09:00:47.431246+0000","last_fullsized":"2024-09-19T09:00:47.431246+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:07.247315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.190094+0000","last_change":"2024-09-19T09:00:35.056009+0000","last_active":"2024-09-19T09:01:15.190094+0000","last_peered":"2024-09-19T09:01:15.190094+0000","last_clean":"2024-09-19T09:01:15.190094+0000","last_became_active":"2024-09-19T09:00:35.055651+0000","last_became_peered":"2024-09-19T09:00:35.055651+0000","last_unstale":"2024-09-19T09:01:15.190094+0000","last_undegraded":"2024-09-19T09:01:15.190094+0000","last_fullsized":"2024-09-19T09:01:15.190094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:36.726272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133311+0000","last_change":"2024-09-19T09:00:44.135629+0000","last_active":"2024-09-19T09:00:47.133311+0000","last_peered":"2024-09-19T09:00:47.133311+0000","last_clean":"2024-09-19T09:00:47.133311+0000","last_became_active":"2024-09-19T09:00:44.135253+0000","last_became_peered":"2024-09-19T09:00:44.135253+0000","last_unstale":"2024-09-19T09:00:47.133311+0000","last_undegraded":"2024-09-19T09:00:47.133311+0000","last_fullsized":"2024-09-19T09:00:47.133311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:37.767455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431472+0000","last_change":"2024-09-19T09:00:37.084042+0000","last_active":"2024-09-19T09:00:47.431472+0000","last_peered":"2024-09-19T09:00:47.431472+0000","last_clean":"2024-09-19T09:00:47.431472+0000","last_became_active":"2024-09-19T09:00:37.083512+0000","last_became_peered":"2024-09-19T09:00:37.083512+0000","last_unstale":"2024-09-19T09:00:47.431472+0000","last_undegraded":"2024-09-19T09:00:47.431472+0000","last_fullsized":"2024-09-19T09:00:47.431472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:07.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.196804+0000","last_change":"2024-09-19T09:00:35.056202+0000","last_active":"2024-09-19T09:01:15.196804+0000","last_peered":"2024-09-19T09:01:15.196804+0000","last_clean":"2024-09-19T09:01:15.196804+0000","last_became_active":"2024-09-19T09:00:35.055867+0000","last_became_peered":"2024-09-19T09:00:35.055867+0000","last_unstale":"2024-09-19T09:01:15.196804+0000","last_undegraded":"2024-09-19T09:01:15.196804+0000","last_fullsized":"2024-09-19T09:01:15.196804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:08.852400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430068+0000","last_change":"2024-09-19T09:00:44.133928+0000","last_active":"2024-09-19T09:00:47.430068+0000","last_peered":"2024-09-19T09:00:47.430068+0000","last_clean":"2024-09-19T09:00:47.430068+0000","last_became_active":"2024-09-19T09:00:44.133077+0000","last_became_peered":"2024-09-19T09:00:44.133077+0000","last_unstale":"2024-09-19T09:00:47.430068+0000","last_undegraded":"2024-09-19T09:00:47.430068+0000","last_fullsized":"2024-09-19T09:00:47.430068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:37.349942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431172+0000","last_change":"2024-09-19T09:00:37.080009+0000","last_active":"2024-09-19T09:00:47.431172+0000","last_peered":"2024-09-19T09:00:47.431172+0000","last_clean":"2024-09-19T09:00:47.431172+0000","last_became_active":"2024-09-19T09:00:37.079291+0000","last_became_peered":"2024-09-19T09:00:37.079291+0000","last_unstale":"2024-09-19T09:00:47.431172+0000","last_undegraded":"2024-09-19T09:00:47.431172+0000","last_fullsized":"2024-09-19T09:00:47.431172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:59.095093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.024702+0000","last_change":"2024-09-19T09:00:35.058866+0000","last_active":"2024-09-19T09:01:15.024702+0000","last_peered":"2024-09-19T09:01:15.024702+0000","last_clean":"2024-09-19T09:01:15.024702+0000","last_became_active":"2024-09-19T09:00:35.058318+0000","last_became_peered":"2024-09-19T09:00:35.058318+0000","last_unstale":"2024-09-19T09:01:15.024702+0000","last_undegraded":"2024-09-19T09:01:15.024702+0000","last_fullsized":"2024-09-19T09:01:15.024702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:32.183063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430141+0000","last_change":"2024-09-19T09:00:44.136564+0000","last_active":"2024-09-19T09:00:47.430141+0000","last_peered":"2024-09-19T09:00:47.430141+0000","last_clean":"2024-09-19T09:00:47.430141+0000","last_became_active":"2024-09-19T09:00:44.136192+0000","last_became_peered":"2024-09-19T09:00:44.136192+0000","last_unstale":"2024-09-19T09:00:47.430141+0000","last_undegraded":"2024-09-19T09:00:47.430141+0000","last_fullsized":"2024-09-19T09:00:47.430141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:17.856055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430320+0000","last_change":"2024-09-19T09:00:37.079611+0000","last_active":"2024-09-19T09:00:47.430320+0000","last_peered":"2024-09-19T09:00:47.430320+0000","last_clean":"2024-09-19T09:00:47.430320+0000","last_became_active":"2024-09-19T09:00:37.079135+0000","last_became_peered":"2024-09-19T09:00:37.079135+0000","last_unstale":"2024-09-19T09:00:47.430320+0000","last_undegraded":"2024-09-19T09:00:47.430320+0000","last_fullsized":"2024-09-19T09:00:47.430320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.321754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.190590+0000","last_change":"2024-09-19T09:00:44.144312+0000","last_active":"2024-09-19T09:01:15.190590+0000","last_peered":"2024-09-19T09:01:15.190590+0000","last_clean":"2024-09-19T09:01:15.190590+0000","last_became_active":"2024-09-19T09:00:44.128920+0000","last_became_peered":"2024-09-19T09:00:44.128920+0000","last_unstale":"2024-09-19T09:01:15.190590+0000","last_undegraded":"2024-09-19T09:01:15.190590+0000","last_fullsized":"2024-09-19T09:01:15.190590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:06.640129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430536+0000","last_change":"2024-09-19T09:00:44.134009+0000","last_active":"2024-09-19T09:00:47.430536+0000","last_peered":"2024-09-19T09:00:47.430536+0000","last_clean":"2024-09-19T09:00:47.430536+0000","last_became_active":"2024-09-19T09:00:44.133634+0000","last_became_peered":"2024-09-19T09:00:44.133634+0000","last_unstale":"2024-09-19T09:00:47.430536+0000","last_undegraded":"2024-09-19T09:00:47.430536+0000","last_fullsized":"2024-09-19T09:00:47.430536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.591618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430224+0000","last_change":"2024-09-19T09:00:37.082614+0000","last_active":"2024-09-19T09:00:47.430224+0000","last_peered":"2024-09-19T09:00:47.430224+0000","last_clean":"2024-09-19T09:00:47.430224+0000","last_became_active":"2024-09-19T09:00:37.082316+0000","last_became_peered":"2024-09-19T09:00:37.082316+0000","last_unstale":"2024-09-19T09:00:47.430224+0000","last_undegraded":"2024-09-19T09:00:47.430224+0000","last_fullsized":"2024-09-19T09:00:47.430224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:21.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:26.215460+0000","last_change":"2024-09-19T09:00:35.057270+0000","last_active":"2024-09-19T09:01:26.215460+0000","last_peered":"2024-09-19T09:01:26.215460+0000","last_clean":"2024-09-19T09:01:26.215460+0000","last_became_active":"2024-09-19T09:00:35.056955+0000","last_became_peered":"2024-09-19T09:00:35.056955+0000","last_unstale":"2024-09-19T09:01:26.215460+0000","last_undegraded":"2024-09-19T09:01:26.215460+0000","last_fullsized":"2024-09-19T09:01:26.215460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:11.609975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431140+0000","last_change":"2024-09-19T09:00:44.134923+0000","last_active":"2024-09-19T09:00:47.431140+0000","last_peered":"2024-09-19T09:00:47.431140+0000","last_clean":"2024-09-19T09:00:47.431140+0000","last_became_active":"2024-09-19T09:00:44.133804+0000","last_became_peered":"2024-09-19T09:00:44.133804+0000","last_unstale":"2024-09-19T09:00:47.431140+0000","last_undegraded":"2024-09-19T09:00:47.431140+0000","last_fullsized":"2024-09-19T09:00:47.431140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:34.680466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431379+0000","last_change":"2024-09-19T09:00:37.076171+0000","last_active":"2024-09-19T09:00:47.431379+0000","last_peered":"2024-09-19T09:00:47.431379+0000","last_clean":"2024-09-19T09:00:47.431379+0000","last_became_active":"2024-09-19T09:00:37.074936+0000","last_became_peered":"2024-09-19T09:00:37.074936+0000","last_unstale":"2024-09-19T09:00:47.431379+0000","last_undegraded":"2024-09-19T09:00:47.431379+0000","last_fullsized":"2024-09-19T09:00:47.431379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:40.122044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.196344+0000","last_change":"2024-09-19T09:00:35.055349+0000","last_active":"2024-09-19T09:01:15.196344+0000","last_peered":"2024-09-19T09:01:15.196344+0000","last_clean":"2024-09-19T09:01:15.196344+0000","last_became_active":"2024-09-19T09:00:35.054406+0000","last_became_peered":"2024-09-19T09:00:35.054406+0000","last_unstale":"2024-09-19T09:01:15.196344+0000","last_undegraded":"2024-09-19T09:01:15.196344+0000","last_fullsized":"2024-09-19T09:01:15.196344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:01.640009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430475+0000","last_change":"2024-09-19T09:00:44.133083+0000","last_active":"2024-09-19T09:00:47.430475+0000","last_peered":"2024-09-19T09:00:47.430475+0000","last_clean":"2024-09-19T09:00:47.430475+0000","last_became_active":"2024-09-19T09:00:44.132661+0000","last_became_peered":"2024-09-19T09:00:44.132661+0000","last_unstale":"2024-09-19T09:00:47.430475+0000","last_undegraded":"2024-09-19T09:00:47.430475+0000","last_fullsized":"2024-09-19T09:00:47.430475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:24.272169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430788+0000","last_change":"2024-09-19T09:00:37.073915+0000","last_active":"2024-09-19T09:00:47.430788+0000","last_peered":"2024-09-19T09:00:47.430788+0000","last_clean":"2024-09-19T09:00:47.430788+0000","last_became_active":"2024-09-19T09:00:37.073560+0000","last_became_peered":"2024-09-19T09:00:37.073560+0000","last_unstale":"2024-09-19T09:00:47.430788+0000","last_undegraded":"2024-09-19T09:00:47.430788+0000","last_fullsized":"2024-09-19T09:00:47.430788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.989827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198709+0000","last_change":"2024-09-19T09:00:35.056260+0000","last_active":"2024-09-19T09:01:15.198709+0000","last_peered":"2024-09-19T09:01:15.198709+0000","last_clean":"2024-09-19T09:01:15.198709+0000","last_became_active":"2024-09-19T09:00:35.055862+0000","last_became_peered":"2024-09-19T09:00:35.055862+0000","last_unstale":"2024-09-19T09:01:15.198709+0000","last_undegraded":"2024-09-19T09:01:15.198709+0000","last_fullsized":"2024-09-19T09:01:15.198709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:12.642021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431117+0000","last_change":"2024-09-19T09:00:44.132934+0000","last_active":"2024-09-19T09:00:47.431117+0000","last_peered":"2024-09-19T09:00:47.431117+0000","last_clean":"2024-09-19T09:00:47.431117+0000","last_became_active":"2024-09-19T09:00:44.132417+0000","last_became_peered":"2024-09-19T09:00:44.132417+0000","last_unstale":"2024-09-19T09:00:47.431117+0000","last_undegraded":"2024-09-19T09:00:47.431117+0000","last_fullsized":"2024-09-19T09:00:47.431117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:19.363149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430344+0000","last_change":"2024-09-19T09:00:37.081436+0000","last_active":"2024-09-19T09:00:47.430344+0000","last_peered":"2024-09-19T09:00:47.430344+0000","last_clean":"2024-09-19T09:00:47.430344+0000","last_became_active":"2024-09-19T09:00:37.081114+0000","last_became_peered":"2024-09-19T09:00:37.081114+0000","last_unstale":"2024-09-19T09:00:47.430344+0000","last_undegraded":"2024-09-19T09:00:47.430344+0000","last_fullsized":"2024-09-19T09:00:47.430344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:54.360471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'31","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:29.225342+0000","last_change":"2024-09-19T09:00:35.056632+0000","last_active":"2024-09-19T09:01:29.225342+0000","last_peered":"2024-09-19T09:01:29.225342+0000","last_clean":"2024-09-19T09:01:29.225342+0000","last_became_active":"2024-09-19T09:00:35.055468+0000","last_became_peered":"2024-09-19T09:00:35.055468+0000","last_unstale":"2024-09-19T09:01:29.225342+0000","last_undegraded":"2024-09-19T09:01:29.225342+0000","last_fullsized":"2024-09-19T09:01:29.225342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:01.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52408,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430706+0000","last_change":"2024-09-19T09:00:44.128870+0000","last_active":"2024-09-19T09:00:47.430706+0000","last_peered":"2024-09-19T09:00:47.430706+0000","last_clean":"2024-09-19T09:00:47.430706+0000","last_became_active":"2024-09-19T09:00:44.128494+0000","last_became_peered":"2024-09-19T09:00:44.128494+0000","last_unstale":"2024-09-19T09:00:47.430706+0000","last_undegraded":"2024-09-19T09:00:47.430706+0000","last_fullsized":"2024-09-19T09:00:47.430706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:20.208407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430529+0000","last_change":"2024-09-19T09:00:37.086507+0000","last_active":"2024-09-19T09:00:47.430529+0000","last_peered":"2024-09-19T09:00:47.430529+0000","last_clean":"2024-09-19T09:00:47.430529+0000","last_became_active":"2024-09-19T09:00:37.086051+0000","last_became_peered":"2024-09-19T09:00:37.086051+0000","last_unstale":"2024-09-19T09:00:47.430529+0000","last_undegraded":"2024-09-19T09:00:47.430529+0000","last_fullsized":"2024-09-19T09:00:47.430529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:31.301804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.033244+0000","last_change":"2024-09-19T09:00:35.501772+0000","last_active":"2024-09-19T09:01:15.033244+0000","last_peered":"2024-09-19T09:01:15.033244+0000","last_clean":"2024-09-19T09:01:15.033244+0000","last_became_active":"2024-09-19T09:00:35.501413+0000","last_became_peered":"2024-09-19T09:00:35.501413+0000","last_unstale":"2024-09-19T09:01:15.033244+0000","last_undegraded":"2024-09-19T09:01:15.033244+0000","last_fullsized":"2024-09-19T09:01:15.033244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:31.806234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431549+0000","last_change":"2024-09-19T09:00:44.132702+0000","last_active":"2024-09-19T09:00:47.431549+0000","last_peered":"2024-09-19T09:00:47.431549+0000","last_clean":"2024-09-19T09:00:47.431549+0000","last_became_active":"2024-09-19T09:00:44.132218+0000","last_became_peered":"2024-09-19T09:00:44.132218+0000","last_unstale":"2024-09-19T09:00:47.431549+0000","last_undegraded":"2024-09-19T09:00:47.431549+0000","last_fullsized":"2024-09-19T09:00:47.431549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:48.884328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133576+0000","last_change":"2024-09-19T09:00:37.078120+0000","last_active":"2024-09-19T09:00:47.133576+0000","last_peered":"2024-09-19T09:00:47.133576+0000","last_clean":"2024-09-19T09:00:47.133576+0000","last_became_active":"2024-09-19T09:00:37.077885+0000","last_became_peered":"2024-09-19T09:00:37.077885+0000","last_unstale":"2024-09-19T09:00:47.133576+0000","last_undegraded":"2024-09-19T09:00:47.133576+0000","last_fullsized":"2024-09-19T09:00:47.133576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:01.841615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.198830+0000","last_change":"2024-09-19T09:00:35.059612+0000","last_active":"2024-09-19T09:01:15.198830+0000","last_peered":"2024-09-19T09:01:15.198830+0000","last_clean":"2024-09-19T09:01:15.198830+0000","last_became_active":"2024-09-19T09:00:35.059191+0000","last_became_peered":"2024-09-19T09:00:35.059191+0000","last_unstale":"2024-09-19T09:01:15.198830+0000","last_undegraded":"2024-09-19T09:01:15.198830+0000","last_fullsized":"2024-09-19T09:01:15.198830+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:06.600073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429932+0000","last_change":"2024-09-19T09:00:44.131867+0000","last_active":"2024-09-19T09:00:47.429932+0000","last_peered":"2024-09-19T09:00:47.429932+0000","last_clean":"2024-09-19T09:00:47.429932+0000","last_became_active":"2024-09-19T09:00:44.131492+0000","last_became_peered":"2024-09-19T09:00:44.131492+0000","last_unstale":"2024-09-19T09:00:47.429932+0000","last_undegraded":"2024-09-19T09:00:47.429932+0000","last_fullsized":"2024-09-19T09:00:47.429932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:35.746606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430706+0000","last_change":"2024-09-19T09:00:37.080025+0000","last_active":"2024-09-19T09:00:47.430706+0000","last_peered":"2024-09-19T09:00:47.430706+0000","last_clean":"2024-09-19T09:00:47.430706+0000","last_became_active":"2024-09-19T09:00:37.078012+0000","last_became_peered":"2024-09-19T09:00:37.078012+0000","last_unstale":"2024-09-19T09:00:47.430706+0000","last_undegraded":"2024-09-19T09:00:47.430706+0000","last_fullsized":"2024-09-19T09:00:47.430706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:25.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":64,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:29.209534+0000","last_change":"2024-09-19T09:00:35.059391+0000","last_active":"2024-09-19T09:01:29.209534+0000","last_peered":"2024-09-19T09:01:29.209534+0000","last_clean":"2024-09-19T09:01:29.209534+0000","last_became_active":"2024-09-19T09:00:35.059049+0000","last_became_peered":"2024-09-19T09:00:35.059049+0000","last_unstale":"2024-09-19T09:01:29.209534+0000","last_undegraded":"2024-09-19T09:01:29.209534+0000","last_fullsized":"2024-09-19T09:01:29.209534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:00.531411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429558+0000","last_change":"2024-09-19T09:00:44.133665+0000","last_active":"2024-09-19T09:00:47.429558+0000","last_peered":"2024-09-19T09:00:47.429558+0000","last_clean":"2024-09-19T09:00:47.429558+0000","last_became_active":"2024-09-19T09:00:44.133297+0000","last_became_peered":"2024-09-19T09:00:44.133297+0000","last_unstale":"2024-09-19T09:00:47.429558+0000","last_undegraded":"2024-09-19T09:00:47.429558+0000","last_fullsized":"2024-09-19T09:00:47.429558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:18.279936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133396+0000","last_change":"2024-09-19T09:00:44.136292+0000","last_active":"2024-09-19T09:00:47.133396+0000","last_peered":"2024-09-19T09:00:47.133396+0000","last_clean":"2024-09-19T09:00:47.133396+0000","last_became_active":"2024-09-19T09:00:44.135914+0000","last_became_peered":"2024-09-19T09:00:44.135914+0000","last_unstale":"2024-09-19T09:00:47.133396+0000","last_undegraded":"2024-09-19T09:00:47.133396+0000","last_fullsized":"2024-09-19T09:00:47.133396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:00.998217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429903+0000","last_change":"2024-09-19T09:00:37.066933+0000","last_active":"2024-09-19T09:00:47.429903+0000","last_peered":"2024-09-19T09:00:47.429903+0000","last_clean":"2024-09-19T09:00:47.429903+0000","last_became_active":"2024-09-19T09:00:37.066634+0000","last_became_peered":"2024-09-19T09:00:37.066634+0000","last_unstale":"2024-09-19T09:00:47.429903+0000","last_undegraded":"2024-09-19T09:00:47.429903+0000","last_fullsized":"2024-09-19T09:00:47.429903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.192546+0000","last_change":"2024-09-19T09:00:35.057495+0000","last_active":"2024-09-19T09:01:15.192546+0000","last_peered":"2024-09-19T09:01:15.192546+0000","last_clean":"2024-09-19T09:01:15.192546+0000","last_became_active":"2024-09-19T09:00:35.057093+0000","last_became_peered":"2024-09-19T09:00:35.057093+0000","last_unstale":"2024-09-19T09:01:15.192546+0000","last_undegraded":"2024-09-19T09:01:15.192546+0000","last_fullsized":"2024-09-19T09:01:15.192546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:41.278464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431365+0000","last_change":"2024-09-19T09:00:44.135353+0000","last_active":"2024-09-19T09:00:47.431365+0000","last_peered":"2024-09-19T09:00:47.431365+0000","last_clean":"2024-09-19T09:00:47.431365+0000","last_became_active":"2024-09-19T09:00:44.134467+0000","last_became_peered":"2024-09-19T09:00:44.134467+0000","last_unstale":"2024-09-19T09:00:47.431365+0000","last_undegraded":"2024-09-19T09:00:47.431365+0000","last_fullsized":"2024-09-19T09:00:47.431365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:28.795561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429947+0000","last_change":"2024-09-19T09:00:37.067368+0000","last_active":"2024-09-19T09:00:47.429947+0000","last_peered":"2024-09-19T09:00:47.429947+0000","last_clean":"2024-09-19T09:00:47.429947+0000","last_became_active":"2024-09-19T09:00:37.067081+0000","last_became_peered":"2024-09-19T09:00:37.067081+0000","last_unstale":"2024-09-19T09:00:47.429947+0000","last_undegraded":"2024-09-19T09:00:47.429947+0000","last_fullsized":"2024-09-19T09:00:47.429947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:42.069148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:14.029135+0000","last_change":"2024-09-19T09:00:35.052775+0000","last_active":"2024-09-19T09:01:14.029135+0000","last_peered":"2024-09-19T09:01:14.029135+0000","last_clean":"2024-09-19T09:01:14.029135+0000","last_became_active":"2024-09-19T09:00:35.052419+0000","last_became_peered":"2024-09-19T09:00:35.052419+0000","last_unstale":"2024-09-19T09:01:14.029135+0000","last_undegraded":"2024-09-19T09:01:14.029135+0000","last_fullsized":"2024-09-19T09:01:14.029135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:40.156076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:15.033383+0000","last_change":"2024-09-19T09:00:35.055043+0000","last_active":"2024-09-19T09:01:15.033383+0000","last_peered":"2024-09-19T09:01:15.033383+0000","last_clean":"2024-09-19T09:01:15.033383+0000","last_became_active":"2024-09-19T09:00:35.054653+0000","last_became_peered":"2024-09-19T09:00:35.054653+0000","last_unstale":"2024-09-19T09:01:15.033383+0000","last_undegraded":"2024-09-19T09:01:15.033383+0000","last_fullsized":"2024-09-19T09:01:15.033383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.834239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430782+0000","last_change":"2024-09-19T09:00:37.077459+0000","last_active":"2024-09-19T09:00:47.430782+0000","last_peered":"2024-09-19T09:00:47.430782+0000","last_clean":"2024-09-19T09:00:47.430782+0000","last_became_active":"2024-09-19T09:00:37.077130+0000","last_became_peered":"2024-09-19T09:00:37.077130+0000","last_unstale":"2024-09-19T09:00:47.430782+0000","last_undegraded":"2024-09-19T09:00:47.430782+0000","last_fullsized":"2024-09-19T09:00:47.430782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:36.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134278+0000","last_change":"2024-09-19T09:00:44.133996+0000","last_active":"2024-09-19T09:00:47.134278+0000","last_peered":"2024-09-19T09:00:47.134278+0000","last_clean":"2024-09-19T09:00:47.134278+0000","last_became_active":"2024-09-19T09:00:44.133628+0000","last_became_peered":"2024-09-19T09:00:44.133628+0000","last_unstale":"2024-09-19T09:00:47.134278+0000","last_undegraded":"2024-09-19T09:00:47.134278+0000","last_fullsized":"2024-09-19T09:00:47.134278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:50.332457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:01:25.210893+0000","last_change":"2024-09-19T09:00:35.053940+0000","last_active":"2024-09-19T09:01:25.210893+0000","last_peered":"2024-09-19T09:01:25.210893+0000","last_clean":"2024-09-19T09:01:25.210893+0000","last_became_active":"2024-09-19T09:00:35.053537+0000","last_became_peered":"2024-09-19T09:00:35.053537+0000","last_unstale":"2024-09-19T09:01:25.210893+0000","last_undegraded":"2024-09-19T09:01:25.210893+0000","last_fullsized":"2024-09-19T09:01:25.210893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:34.127981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429934+0000","last_change":"2024-09-19T09:00:37.080739+0000","last_active":"2024-09-19T09:00:47.429934+0000","last_peered":"2024-09-19T09:00:47.429934+0000","last_clean":"2024-09-19T09:00:47.429934+0000","last_became_active":"2024-09-19T09:00:37.077474+0000","last_became_peered":"2024-09-19T09:00:37.077474+0000","last_unstale":"2024-09-19T09:00:47.429934+0000","last_undegraded":"2024-09-19T09:00:47.429934+0000","last_fullsized":"2024-09-19T09:00:47.429934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:50.963793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134365+0000","last_change":"2024-09-19T09:00:44.136011+0000","last_active":"2024-09-19T09:00:47.134365+0000","last_peered":"2024-09-19T09:00:47.134365+0000","last_clean":"2024-09-19T09:00:47.134365+0000","last_became_active":"2024-09-19T09:00:44.135614+0000","last_became_peered":"2024-09-19T09:00:44.135614+0000","last_unstale":"2024-09-19T09:00:47.134365+0000","last_undegraded":"2024-09-19T09:00:47.134365+0000","last_fullsized":"2024-09-19T09:00:47.134365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:49.390677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431198+0000","last_change":"2024-09-19T09:00:37.081680+0000","last_active":"2024-09-19T09:00:47.431198+0000","last_peered":"2024-09-19T09:00:47.431198+0000","last_clean":"2024-09-19T09:00:47.431198+0000","last_became_active":"2024-09-19T09:00:37.081355+0000","last_became_peered":"2024-09-19T09:00:37.081355+0000","last_unstale":"2024-09-19T09:00:47.431198+0000","last_undegraded":"2024-09-19T09:00:47.431198+0000","last_fullsized":"2024-09-19T09:00:47.431198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:49.101880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134124+0000","last_change":"2024-09-19T09:00:37.076575+0000","last_active":"2024-09-19T09:00:47.134124+0000","last_peered":"2024-09-19T09:00:47.134124+0000","last_clean":"2024-09-19T09:00:47.134124+0000","last_became_active":"2024-09-19T09:00:37.076167+0000","last_became_peered":"2024-09-19T09:00:37.076167+0000","last_unstale":"2024-09-19T09:00:47.134124+0000","last_undegraded":"2024-09-19T09:00:47.134124+0000","last_fullsized":"2024-09-19T09:00:47.134124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:08.251308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133853+0000","last_change":"2024-09-19T09:00:37.080433+0000","last_active":"2024-09-19T09:00:47.133853+0000","last_peered":"2024-09-19T09:00:47.133853+0000","last_clean":"2024-09-19T09:00:47.133853+0000","last_became_active":"2024-09-19T09:00:37.074803+0000","last_became_peered":"2024-09-19T09:00:37.074803+0000","last_unstale":"2024-09-19T09:00:47.133853+0000","last_undegraded":"2024-09-19T09:00:47.133853+0000","last_fullsized":"2024-09-19T09:00:47.133853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:18.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133271+0000","last_change":"2024-09-19T09:00:37.073227+0000","last_active":"2024-09-19T09:00:47.133271+0000","last_peered":"2024-09-19T09:00:47.133271+0000","last_clean":"2024-09-19T09:00:47.133271+0000","last_became_active":"2024-09-19T09:00:37.072875+0000","last_became_peered":"2024-09-19T09:00:37.072875+0000","last_unstale":"2024-09-19T09:00:47.133271+0000","last_undegraded":"2024-09-19T09:00:47.133271+0000","last_fullsized":"2024-09-19T09:00:47.133271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:09.303029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430039+0000","last_change":"2024-09-19T09:00:37.077978+0000","last_active":"2024-09-19T09:00:47.430039+0000","last_peered":"2024-09-19T09:00:47.430039+0000","last_clean":"2024-09-19T09:00:47.430039+0000","last_became_active":"2024-09-19T09:00:37.077663+0000","last_became_peered":"2024-09-19T09:00:37.077663+0000","last_unstale":"2024-09-19T09:00:47.430039+0000","last_undegraded":"2024-09-19T09:00:47.430039+0000","last_fullsized":"2024-09-19T09:00:47.430039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:22.156471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430909+0000","last_change":"2024-09-19T09:00:37.086723+0000","last_active":"2024-09-19T09:00:47.430909+0000","last_peered":"2024-09-19T09:00:47.430909+0000","last_clean":"2024-09-19T09:00:47.430909+0000","last_became_active":"2024-09-19T09:00:37.086405+0000","last_became_peered":"2024-09-19T09:00:37.086405+0000","last_unstale":"2024-09-19T09:00:47.430909+0000","last_undegraded":"2024-09-19T09:00:47.430909+0000","last_fullsized":"2024-09-19T09:00:47.430909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:21.351964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134487+0000","last_change":"2024-09-19T09:00:37.083033+0000","last_active":"2024-09-19T09:00:47.134487+0000","last_peered":"2024-09-19T09:00:47.134487+0000","last_clean":"2024-09-19T09:00:47.134487+0000","last_became_active":"2024-09-19T09:00:37.082713+0000","last_became_peered":"2024-09-19T09:00:37.082713+0000","last_unstale":"2024-09-19T09:00:47.134487+0000","last_undegraded":"2024-09-19T09:00:47.134487+0000","last_fullsized":"2024-09-19T09:00:47.134487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:27.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430196+0000","last_change":"2024-09-19T09:00:37.076327+0000","last_active":"2024-09-19T09:00:47.430196+0000","last_peered":"2024-09-19T09:00:47.430196+0000","last_clean":"2024-09-19T09:00:47.430196+0000","last_became_active":"2024-09-19T09:00:37.076015+0000","last_became_peered":"2024-09-19T09:00:37.076015+0000","last_unstale":"2024-09-19T09:00:47.430196+0000","last_undegraded":"2024-09-19T09:00:47.430196+0000","last_fullsized":"2024-09-19T09:00:47.430196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.789995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430085+0000","last_change":"2024-09-19T09:00:37.076633+0000","last_active":"2024-09-19T09:00:47.430085+0000","last_peered":"2024-09-19T09:00:47.430085+0000","last_clean":"2024-09-19T09:00:47.430085+0000","last_became_active":"2024-09-19T09:00:37.075725+0000","last_became_peered":"2024-09-19T09:00:37.075725+0000","last_unstale":"2024-09-19T09:00:47.430085+0000","last_undegraded":"2024-09-19T09:00:47.430085+0000","last_fullsized":"2024-09-19T09:00:47.430085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:44.927819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429710+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:00:47.429710+0000","last_peered":"2024-09-19T09:00:47.429710+0000","last_clean":"2024-09-19T09:00:47.429710+0000","last_became_active":"2024-09-19T09:00:37.084998+0000","last_became_peered":"2024-09-19T09:00:37.084998+0000","last_unstale":"2024-09-19T09:00:47.429710+0000","last_undegraded":"2024-09-19T09:00:47.429710+0000","last_fullsized":"2024-09-19T09:00:47.429710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:57.316550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430159+0000","last_change":"2024-09-19T09:00:37.076500+0000","last_active":"2024-09-19T09:00:47.430159+0000","last_peered":"2024-09-19T09:00:47.430159+0000","last_clean":"2024-09-19T09:00:47.430159+0000","last_became_active":"2024-09-19T09:00:37.076135+0000","last_became_peered":"2024-09-19T09:00:37.076135+0000","last_unstale":"2024-09-19T09:00:47.430159+0000","last_undegraded":"2024-09-19T09:00:47.430159+0000","last_fullsized":"2024-09-19T09:00:47.430159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:06.726704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429878+0000","last_change":"2024-09-19T09:00:37.074370+0000","last_active":"2024-09-19T09:00:47.429878+0000","last_peered":"2024-09-19T09:00:47.429878+0000","last_clean":"2024-09-19T09:00:47.429878+0000","last_became_active":"2024-09-19T09:00:37.074076+0000","last_became_peered":"2024-09-19T09:00:37.074076+0000","last_unstale":"2024-09-19T09:00:47.429878+0000","last_undegraded":"2024-09-19T09:00:47.429878+0000","last_fullsized":"2024-09-19T09:00:47.429878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:56.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430581+0000","last_change":"2024-09-19T09:00:37.078887+0000","last_active":"2024-09-19T09:00:47.430581+0000","last_peered":"2024-09-19T09:00:47.430581+0000","last_clean":"2024-09-19T09:00:47.430581+0000","last_became_active":"2024-09-19T09:00:37.078192+0000","last_became_peered":"2024-09-19T09:00:37.078192+0000","last_unstale":"2024-09-19T09:00:47.430581+0000","last_undegraded":"2024-09-19T09:00:47.430581+0000","last_fullsized":"2024-09-19T09:00:47.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134442+0000","last_change":"2024-09-19T09:00:37.075932+0000","last_active":"2024-09-19T09:00:47.134442+0000","last_peered":"2024-09-19T09:00:47.134442+0000","last_clean":"2024-09-19T09:00:47.134442+0000","last_became_active":"2024-09-19T09:00:37.074637+0000","last_became_peered":"2024-09-19T09:00:37.074637+0000","last_unstale":"2024-09-19T09:00:47.134442+0000","last_undegraded":"2024-09-19T09:00:47.134442+0000","last_fullsized":"2024-09-19T09:00:47.134442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:27.423717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430890+0000","last_change":"2024-09-19T09:00:37.072804+0000","last_active":"2024-09-19T09:00:47.430890+0000","last_peered":"2024-09-19T09:00:47.430890+0000","last_clean":"2024-09-19T09:00:47.430890+0000","last_became_active":"2024-09-19T09:00:37.072500+0000","last_became_peered":"2024-09-19T09:00:37.072500+0000","last_unstale":"2024-09-19T09:00:47.430890+0000","last_undegraded":"2024-09-19T09:00:47.430890+0000","last_fullsized":"2024-09-19T09:00:47.430890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:56.035111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431747+0000","last_change":"2024-09-19T09:00:37.083195+0000","last_active":"2024-09-19T09:00:47.431747+0000","last_peered":"2024-09-19T09:00:47.431747+0000","last_clean":"2024-09-19T09:00:47.431747+0000","last_became_active":"2024-09-19T09:00:37.082332+0000","last_became_peered":"2024-09-19T09:00:37.082332+0000","last_unstale":"2024-09-19T09:00:47.431747+0000","last_undegraded":"2024-09-19T09:00:47.431747+0000","last_fullsized":"2024-09-19T09:00:47.431747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:12.802785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429829+0000","last_change":"2024-09-19T09:00:37.076955+0000","last_active":"2024-09-19T09:00:47.429829+0000","last_peered":"2024-09-19T09:00:47.429829+0000","last_clean":"2024-09-19T09:00:47.429829+0000","last_became_active":"2024-09-19T09:00:37.076637+0000","last_became_peered":"2024-09-19T09:00:37.076637+0000","last_unstale":"2024-09-19T09:00:47.429829+0000","last_undegraded":"2024-09-19T09:00:47.429829+0000","last_fullsized":"2024-09-19T09:00:47.429829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:51.181157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133095+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:00:47.133095+0000","last_peered":"2024-09-19T09:00:47.133095+0000","last_clean":"2024-09-19T09:00:47.133095+0000","last_became_active":"2024-09-19T09:00:37.084976+0000","last_became_peered":"2024-09-19T09:00:37.084976+0000","last_unstale":"2024-09-19T09:00:47.133095+0000","last_undegraded":"2024-09-19T09:00:47.133095+0000","last_fullsized":"2024-09-19T09:00:47.133095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:23.120946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133150+0000","last_change":"2024-09-19T09:00:37.082788+0000","last_active":"2024-09-19T09:00:47.133150+0000","last_peered":"2024-09-19T09:00:47.133150+0000","last_clean":"2024-09-19T09:00:47.133150+0000","last_became_active":"2024-09-19T09:00:37.082460+0000","last_became_peered":"2024-09-19T09:00:37.082460+0000","last_unstale":"2024-09-19T09:00:47.133150+0000","last_undegraded":"2024-09-19T09:00:47.133150+0000","last_fullsized":"2024-09-19T09:00:47.133150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:17.191671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429778+0000","last_change":"2024-09-19T09:00:37.075908+0000","last_active":"2024-09-19T09:00:47.429778+0000","last_peered":"2024-09-19T09:00:47.429778+0000","last_clean":"2024-09-19T09:00:47.429778+0000","last_became_active":"2024-09-19T09:00:37.075579+0000","last_became_peered":"2024-09-19T09:00:37.075579+0000","last_unstale":"2024-09-19T09:00:47.429778+0000","last_undegraded":"2024-09-19T09:00:47.429778+0000","last_fullsized":"2024-09-19T09:00:47.429778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:53.620585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431281+0000","last_change":"2024-09-19T09:00:37.084392+0000","last_active":"2024-09-19T09:00:47.431281+0000","last_peered":"2024-09-19T09:00:47.431281+0000","last_clean":"2024-09-19T09:00:47.431281+0000","last_became_active":"2024-09-19T09:00:37.084074+0000","last_became_peered":"2024-09-19T09:00:37.084074+0000","last_unstale":"2024-09-19T09:00:47.431281+0000","last_undegraded":"2024-09-19T09:00:47.431281+0000","last_fullsized":"2024-09-19T09:00:47.431281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:20.585494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431530+0000","last_change":"2024-09-19T09:00:37.084436+0000","last_active":"2024-09-19T09:00:47.431530+0000","last_peered":"2024-09-19T09:00:47.431530+0000","last_clean":"2024-09-19T09:00:47.431530+0000","last_became_active":"2024-09-19T09:00:37.083720+0000","last_became_peered":"2024-09-19T09:00:37.083720+0000","last_unstale":"2024-09-19T09:00:47.431530+0000","last_undegraded":"2024-09-19T09:00:47.431530+0000","last_fullsized":"2024-09-19T09:00:47.431530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.900914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.134442+0000","last_change":"2024-09-19T09:00:37.080816+0000","last_active":"2024-09-19T09:00:47.134442+0000","last_peered":"2024-09-19T09:00:47.134442+0000","last_clean":"2024-09-19T09:00:47.134442+0000","last_became_active":"2024-09-19T09:00:37.080493+0000","last_became_peered":"2024-09-19T09:00:37.080493+0000","last_unstale":"2024-09-19T09:00:47.134442+0000","last_undegraded":"2024-09-19T09:00:47.134442+0000","last_fullsized":"2024-09-19T09:00:47.134442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:18.862965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430970+0000","last_change":"2024-09-19T09:00:37.079203+0000","last_active":"2024-09-19T09:00:47.430970+0000","last_peered":"2024-09-19T09:00:47.430970+0000","last_clean":"2024-09-19T09:00:47.430970+0000","last_became_active":"2024-09-19T09:00:37.078851+0000","last_became_peered":"2024-09-19T09:00:37.078851+0000","last_unstale":"2024-09-19T09:00:47.430970+0000","last_undegraded":"2024-09-19T09:00:47.430970+0000","last_fullsized":"2024-09-19T09:00:47.430970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:16.640023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.429655+0000","last_change":"2024-09-19T09:00:37.077327+0000","last_active":"2024-09-19T09:00:47.429655+0000","last_peered":"2024-09-19T09:00:47.429655+0000","last_clean":"2024-09-19T09:00:47.429655+0000","last_became_active":"2024-09-19T09:00:37.077016+0000","last_became_peered":"2024-09-19T09:00:37.077016+0000","last_unstale":"2024-09-19T09:00:47.429655+0000","last_undegraded":"2024-09-19T09:00:47.429655+0000","last_fullsized":"2024-09-19T09:00:47.429655+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:39.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430365+0000","last_change":"2024-09-19T09:00:37.081849+0000","last_active":"2024-09-19T09:00:47.430365+0000","last_peered":"2024-09-19T09:00:47.430365+0000","last_clean":"2024-09-19T09:00:47.430365+0000","last_became_active":"2024-09-19T09:00:37.081508+0000","last_became_peered":"2024-09-19T09:00:37.081508+0000","last_unstale":"2024-09-19T09:00:47.430365+0000","last_undegraded":"2024-09-19T09:00:47.430365+0000","last_fullsized":"2024-09-19T09:00:47.430365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:53.502987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133974+0000","last_change":"2024-09-19T09:00:37.074201+0000","last_active":"2024-09-19T09:00:47.133974+0000","last_peered":"2024-09-19T09:00:47.133974+0000","last_clean":"2024-09-19T09:00:47.133974+0000","last_became_active":"2024-09-19T09:00:37.073833+0000","last_became_peered":"2024-09-19T09:00:37.073833+0000","last_unstale":"2024-09-19T09:00:47.133974+0000","last_undegraded":"2024-09-19T09:00:47.133974+0000","last_fullsized":"2024-09-19T09:00:47.133974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:45.016566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.430134+0000","last_change":"2024-09-19T09:00:37.078436+0000","last_active":"2024-09-19T09:00:47.430134+0000","last_peered":"2024-09-19T09:00:47.430134+0000","last_clean":"2024-09-19T09:00:47.430134+0000","last_became_active":"2024-09-19T09:00:37.077648+0000","last_became_peered":"2024-09-19T09:00:37.077648+0000","last_unstale":"2024-09-19T09:00:47.430134+0000","last_undegraded":"2024-09-19T09:00:47.430134+0000","last_fullsized":"2024-09-19T09:00:47.430134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.258856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431031+0000","last_change":"2024-09-19T09:00:44.131018+0000","last_active":"2024-09-19T09:00:47.431031+0000","last_peered":"2024-09-19T09:00:47.431031+0000","last_clean":"2024-09-19T09:00:47.431031+0000","last_became_active":"2024-09-19T09:00:44.130698+0000","last_became_peered":"2024-09-19T09:00:44.130698+0000","last_unstale":"2024-09-19T09:00:47.431031+0000","last_undegraded":"2024-09-19T09:00:47.431031+0000","last_fullsized":"2024-09-19T09:00:47.431031+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:57.552728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133203+0000","last_change":"2024-09-19T09:00:37.085490+0000","last_active":"2024-09-19T09:00:47.133203+0000","last_peered":"2024-09-19T09:00:47.133203+0000","last_clean":"2024-09-19T09:00:47.133203+0000","last_became_active":"2024-09-19T09:00:37.085171+0000","last_became_peered":"2024-09-19T09:00:37.085171+0000","last_unstale":"2024-09-19T09:00:47.133203+0000","last_undegraded":"2024-09-19T09:00:47.133203+0000","last_fullsized":"2024-09-19T09:00:47.133203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:48.252031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.133302+0000","last_change":"2024-09-19T09:00:37.071638+0000","last_active":"2024-09-19T09:00:47.133302+0000","last_peered":"2024-09-19T09:00:47.133302+0000","last_clean":"2024-09-19T09:00:47.133302+0000","last_became_active":"2024-09-19T09:00:37.071303+0000","last_became_peered":"2024-09-19T09:00:37.071303+0000","last_unstale":"2024-09-19T09:00:47.133302+0000","last_undegraded":"2024-09-19T09:00:47.133302+0000","last_fullsized":"2024-09-19T09:00:47.133302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:41.590831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:00:47.431650+0000","last_change":"2024-09-19T09:00:37.083761+0000","last_active":"2024-09-19T09:00:47.431650+0000","last_peered":"2024-09-19T09:00:47.431650+0000","last_clean":"2024-09-19T09:00:47.431650+0000","last_became_active":"2024-09-19T09:00:37.079681+0000","last_became_peered":"2024-09-19T09:00:37.079681+0000","last_unstale":"2024-09-19T09:00:47.431650+0000","last_undegraded":"2024-09-19T09:00:47.431650+0000","last_fullsized":"2024-09-19T09:00:47.431650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:35.104720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59616,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":177,"num_read_kb":158,"num_write":241,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":160722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":487219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1126724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939681,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":491133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201319,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":487303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1084307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593777,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":482934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36924,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708228,"statfs":{"total":95995035648,"available":95957225472,"internally_reserved":0,"allocated":1617920,"data_stored":1079103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018938,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":488178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247870,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":482249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476805,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":525966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":527309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":483997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":44147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:01:32.988 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:01:32.989 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:01:32.989 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:01:33.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:33 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:33.252 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:33 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:33.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:33 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:33.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 -- 172.21.15.83:0/2465490143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 msgr2=0x7fd51c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 --2- 172.21.15.83:0/2465490143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c102150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd508009900 tx=0x7fd50802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 -- 172.21.15.83:0/2465490143 shutdown_connections 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 --2- 172.21.15.83:0/2465490143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd51c102690 0x7fd51c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 --2- 172.21.15.83:0/2465490143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c102150 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 --2- 172.21.15.83:0/2465490143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd51c100ad0 0x7fd51c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 -- 172.21.15.83:0/2465490143 >> 172.21.15.83:0/2465490143 conn(0x7fd51c0fc280 msgr2=0x7fd51c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 -- 172.21.15.83:0/2465490143 shutdown_connections 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 -- 172.21.15.83:0/2465490143 wait complete. 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 Processor -- start 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.728+0000 7fd522de4640 1 -- start start 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd51c100ad0 0x7fd51c10b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd51c102690 0x7fd51c109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd51c10d730 con 0x7fd51c101cd0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd51c10d5b0 con 0x7fd51c100ad0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd51c10d8b0 con 0x7fd51c102690 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34358/0 (socket says 172.21.15.83:34358) 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 -- 172.21.15.83:0/1247594133 learned_addr learned my addr 172.21.15.83:0/1247594133 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd521381640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd51c102690 0x7fd51c109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd520b80640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd51c100ad0 0x7fd51c10b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 -- 172.21.15.83:0/1247594133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd51c102690 msgr2=0x7fd51c109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd51c102690 0x7fd51c109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 -- 172.21.15.83:0/1247594133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd51c100ad0 msgr2=0x7fd51c10b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd51c100ad0 0x7fd51c10b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 -- 172.21.15.83:0/1247594133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51c10a8a0 con 0x7fd51c101cd0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd51bfff640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c109aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd508004770 tx=0x7fd5080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:33.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50803f030 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd508003cb0 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51c1a1f60 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.729+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508035070 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.730+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51c1a23b0 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.731+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51c107fc0 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.732+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd508042030 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.732+0000 7fd519ffb640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd50c0a3350 0x7fd50c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.732+0000 7fd520b80640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd50c0a3350 0x7fd50c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.732+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fd5080f0640 con 0x7fd51c101cd0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.733+0000 7fd520b80640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd50c0a3350 0x7fd50c0a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd51c101b30 tx=0x7fd510005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:33.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.736+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5080bcf20 con 0x7fd51c101cd0 2024-09-19T09:01:33.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.974+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fd51c062e20 con 0x7fd51c101cd0 2024-09-19T09:01:33.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.976+0000 7fd519ffb640 1 -- 172.21.15.83:0/1247594133 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fd5080bc820 con 0x7fd51c101cd0 2024-09-19T09:01:33.977 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-09-19T09:01:33.977 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBt6OtmKJk5OhAAiTwUs9/EDqG/I8LwfTIejg== 2024-09-19T09:01:33.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd50c0a3350 msgr2=0x7fd50c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd50c0a3350 0x7fd50c0a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd51c101b30 tx=0x7fd510005c60 comp rx=0 tx=0).stop 2024-09-19T09:01:33.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 msgr2=0x7fd51c109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c109aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd508004770 tx=0x7fd5080042f0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 shutdown_connections 2024-09-19T09:01:33.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd50c0a3350 0x7fd50c0a5810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd51c102690 0x7fd51c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd51c101cd0 0x7fd51c109aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 --2- 172.21.15.83:0/1247594133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd51c100ad0 0x7fd51c10b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 >> 172.21.15.83:0/1247594133 conn(0x7fd51c0fc280 msgr2=0x7fd51c105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:33.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 shutdown_connections 2024-09-19T09:01:33.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:33.980+0000 7fd522de4640 1 -- 172.21.15.83:0/1247594133 wait complete. 2024-09-19T09:01:34.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:34 smithi184 ceph-mon[35007]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:01:34.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:34 smithi184 ceph-mon[35007]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T09:01:34.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:34 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1247594133' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:01:34.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:34 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1247594133' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:01:34.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:34 smithi122 ceph-mon[34247]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:01:34.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:34 smithi122 ceph-mon[34247]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T09:01:34.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:34 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1247594133' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:01:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:34 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1247594133' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:01:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:34 smithi083 ceph-mon[30926]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:01:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:34 smithi083 ceph-mon[30926]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T09:01:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:34 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1247594133' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:01:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:34 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1247594133' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:01:34.881 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:01:34.881 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:01:34.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:01:34.919 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:01:34.919 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:01:34.919 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:01:35.293 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:35.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.697 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.697 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.697 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:35 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.697 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:35 smithi083 ceph-mon[30926]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T09:01:35.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:35 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:35 smithi122 ceph-mon[34247]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 -- 172.21.15.83:0/1009829079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 msgr2=0x7f10bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 --2- 172.21.15.83:0/1009829079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1021c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009900 tx=0x7f10ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 -- 172.21.15.83:0/1009829079 shutdown_connections 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 --2- 172.21.15.83:0/1009829079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10bc106f10 0x7f10bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 --2- 172.21.15.83:0/1009829079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc102790 0x7f10bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 --2- 172.21.15.83:0/1009829079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1021c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 -- 172.21.15.83:0/1009829079 >> 172.21.15.83:0/1009829079 conn(0x7f10bc0fd8c0 msgr2=0x7f10bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 -- 172.21.15.83:0/1009829079 shutdown_connections 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 -- 172.21.15.83:0/1009829079 wait complete. 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 Processor -- start 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.776+0000 7f10c2713640 1 -- start start 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10bc102790 0x7f10bc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc106f10 0x7f10bc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc111e40 con 0x7f10bc101de0 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc111cc0 con 0x7f10bc102790 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc111fc0 con 0x7f10bc106f10 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34376/0 (socket says 172.21.15.83:34376) 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 -- 172.21.15.83:0/2133174599 learned_addr learned my addr 172.21.15.83:0/2133174599 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:35.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c0cb0640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc106f10 0x7f10bc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 -- 172.21.15.83:0/2133174599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc106f10 msgr2=0x7f10bc19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc106f10 0x7f10bc19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 -- 172.21.15.83:0/2133174599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10bc102790 msgr2=0x7f10bc1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10bc102790 0x7f10bc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 -- 172.21.15.83:0/2133174599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc19d460 con 0x7f10bc101de0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c0cb0640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc106f10 0x7f10bc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10bbfff640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1984b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005940 tx=0x7f10ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac03f030 con 0x7f10bc101de0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10ac003aa0 con 0x7f10bc101de0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10bc19d6f0 con 0x7f10bc101de0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac035070 con 0x7f10bc101de0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.777+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10bc1a5030 con 0x7f10bc101de0 2024-09-19T09:01:35.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.779+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10bc1032c0 con 0x7f10bc101de0 2024-09-19T09:01:35.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.779+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f10ac042030 con 0x7f10bc101de0 2024-09-19T09:01:35.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.780+0000 7f10b97fa640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f10a80a32d0 0x7f10a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.780+0000 7f10bb7fe640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f10a80a32d0 0x7f10a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.780+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f10ac0f0620 con 0x7f10bc101de0 2024-09-19T09:01:35.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.780+0000 7f10bb7fe640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f10a80a32d0 0x7f10a80a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10a4005fd0 tx=0x7f10a4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:35.784+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10ac0bcf00 con 0x7f10bc101de0 2024-09-19T09:01:35.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:35 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:35 smithi184 ceph-mon[35007]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T09:01:36.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.023+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f10bc10a0f0 con 0x7f10bc101de0 2024-09-19T09:01:36.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.028+0000 7f10b97fa640 1 -- 172.21.15.83:0/2133174599 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264048 (secure 0 0 0) 0x7f10ac0bc800 con 0x7f10bc101de0 2024-09-19T09:01:36.031 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:36.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f10a80a32d0 msgr2=0x7f10a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:36.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f10a80a32d0 0x7f10a80a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10a4005fd0 tx=0x7f10a4005850 comp rx=0 tx=0).stop 2024-09-19T09:01:36.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 msgr2=0x7f10bc1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:36.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1984b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005940 tx=0x7f10ac004270 comp rx=0 tx=0).stop 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 shutdown_connections 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f10a80a32d0 0x7f10a80a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10bc106f10 0x7f10bc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10bc102790 0x7f10bc1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 --2- 172.21.15.83:0/2133174599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10bc101de0 0x7f10bc1984b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 >> 172.21.15.83:0/2133174599 conn(0x7f10bc0fd8c0 msgr2=0x7f10bc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 shutdown_connections 2024-09-19T09:01:36.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:36.031+0000 7f10c2713640 1 -- 172.21.15.83:0/2133174599 wait complete. 2024-09-19T09:01:36.769 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:36 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2133174599' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:01:36.769 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:36 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:36.769 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:36 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:36.794 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":2542755280},{"type":"v1","addr":"172.21.15.83:6801","nonce":2542755280}]},"active_addr":"172.21.15.83:6801/2542755280","active_change":"2024-09-19T08:53:42.831808+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.83:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3109717577}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":931956178}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":512658189}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3669863104}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1870172653}]}]} 2024-09-19T09:01:36.801 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:01:36.801 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:01:36.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:01:36.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:36 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2133174599' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:01:36.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:36 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:36.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:36 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:36.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:36 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2133174599' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:01:36.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:36 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:36.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:36 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:37.056 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:37.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 -- 172.21.15.83:0/580512419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 msgr2=0x7f8238107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 --2- 172.21.15.83:0/580512419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238107b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8220009930 tx=0x7f822002a420 comp rx=0 tx=0).stop 2024-09-19T09:01:37.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 -- 172.21.15.83:0/580512419 shutdown_connections 2024-09-19T09:01:37.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 --2- 172.21.15.83:0/580512419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82381082a0 0x7f823810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 --2- 172.21.15.83:0/580512419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238107b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 --2- 172.21.15.83:0/580512419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8238102d30 0x7f8238103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 -- 172.21.15.83:0/580512419 >> 172.21.15.83:0/580512419 conn(0x7f82380fc7d0 msgr2=0x7f82380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 -- 172.21.15.83:0/580512419 shutdown_connections 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 -- 172.21.15.83:0/580512419 wait complete. 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.537+0000 7f823e49a640 1 Processor -- start 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 -- start start 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8238102d30 0x7f8238100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82381082a0 0x7f8238101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8238111f70 con 0x7f82381036e0 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8238111df0 con 0x7f82381082a0 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823e49a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f82381120f0 con 0x7f8238102d30 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34392/0 (socket says 172.21.15.83:34392) 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 -- 172.21.15.83:0/3476102833 learned_addr learned my addr 172.21.15.83:0/3476102833 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f8237fff640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8238102d30 0x7f8238100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f823ca37640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82381082a0 0x7f8238101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 -- 172.21.15.83:0/3476102833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8238102d30 msgr2=0x7f8238100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8238102d30 0x7f8238100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 -- 172.21.15.83:0/3476102833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82381082a0 msgr2=0x7f8238101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82381082a0 0x7f8238101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.538+0000 7f82377fe640 1 -- 172.21.15.83:0/3476102833 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82381a69b0 con 0x7f82381036e0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.539+0000 7f82377fe640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238100ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8220009230 tx=0x7f8220004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.539+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822003f030 con 0x7f82381036e0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.539+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82200035f0 con 0x7f82381036e0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.539+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82381a6c40 con 0x7f82381036e0 2024-09-19T09:01:37.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.539+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220035070 con 0x7f82381036e0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.539+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82381a7120 con 0x7f82381036e0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.540+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8238103110 con 0x7f82381036e0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.541+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8220003aa0 con 0x7f82381036e0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.542+0000 7f82357fa640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82240a32d0 0x7f82240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.542+0000 7f8237fff640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82240a32d0 0x7f82240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.542+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f82200f0dc0 con 0x7f82381036e0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.542+0000 7f8237fff640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82240a32d0 0x7f82240a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8228009890 tx=0x7f8228008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.545+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82200bd6a0 con 0x7f82381036e0 2024-09-19T09:01:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:37 smithi083 ceph-mon[30926]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-19T09:01:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:37 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:37.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.717+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f823810a2b0 con 0x7f82381036e0 2024-09-19T09:01:37.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.718+0000 7f82357fa640 1 -- 172.21.15.83:0/3476102833 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7f82200bcfa0 con 0x7f82381036e0 2024-09-19T09:01:37.718 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:37.718 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.720+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82240a32d0 msgr2=0x7f82240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.720+0000 7f823e49a640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82240a32d0 0x7f82240a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8228009890 tx=0x7f8228008040 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 msgr2=0x7f8238100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238100ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8220009230 tx=0x7f8220004270 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 shutdown_connections 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f82240a32d0 0x7f82240a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82381082a0 0x7f8238101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82381036e0 0x7f8238100ed0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 --2- 172.21.15.83:0/3476102833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8238102d30 0x7f8238100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 >> 172.21.15.83:0/3476102833 conn(0x7f82380fc7d0 msgr2=0x7f8238105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 shutdown_connections 2024-09-19T09:01:37.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:37.721+0000 7f823e49a640 1 -- 172.21.15.83:0/3476102833 wait complete. 2024-09-19T09:01:37.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:37 smithi184 ceph-mon[35007]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-19T09:01:37.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:37.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:37 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:37.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:37 smithi122 ceph-mon[34247]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-19T09:01:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:37 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:01:38.473 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:01:38.474 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:01:38.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:38 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3476102833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.720 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:38.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:38 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3476102833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:38 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3476102833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 -- 172.21.15.83:0/4182521591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 msgr2=0x7feb1810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/4182521591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb1810d950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feb08009cd0 tx=0x7feb0802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 -- 172.21.15.83:0/4182521591 shutdown_connections 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/4182521591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb1810d950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/4182521591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb18100a80 0x7feb18100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/4182521591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18106a80 0x7feb18106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 -- 172.21.15.83:0/4182521591 >> 172.21.15.83:0/4182521591 conn(0x7feb180fc7a0 msgr2=0x7feb180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 -- 172.21.15.83:0/4182521591 shutdown_connections 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 -- 172.21.15.83:0/4182521591 wait complete. 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.178+0000 7feb1d9d5640 1 Processor -- start 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 -- start start 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18100a80 0x7feb18199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb181998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb18106a80 0x7feb181a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feb18110dd0 con 0x7feb18101420 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feb18110c50 con 0x7feb18106a80 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb1d9d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feb18110f50 con 0x7feb18100a80 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb181998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb181998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34408/0 (socket says 172.21.15.83:34408) 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 -- 172.21.15.83:0/189884845 learned_addr learned my addr 172.21.15.83:0/189884845 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb177fe640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb18106a80 0x7feb181a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb16ffd640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18100a80 0x7feb18199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 -- 172.21.15.83:0/189884845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18100a80 msgr2=0x7feb18199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18100a80 0x7feb18199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 -- 172.21.15.83:0/189884845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb18106a80 msgr2=0x7feb181a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb18106a80 0x7feb181a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 -- 172.21.15.83:0/189884845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb181a4920 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb16ffd640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18100a80 0x7feb18199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.179+0000 7feb167fc640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb181998a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00b4a0 tx=0x7feb0c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.180+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c014070 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.180+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb0c010ac0 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.180+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb181a4af0 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.180+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c017c30 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.180+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb181a5030 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.181+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb18100f60 con 0x7feb18101420 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.182+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feb0c017070 con 0x7feb18101420 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.182+0000 7feb1c9d3640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7feb000a3350 0x7feb000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.182+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7feb0c0cf290 con 0x7feb18101420 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.182+0000 7feb16ffd640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7feb000a3350 0x7feb000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.183+0000 7feb16ffd640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7feb000a3350 0x7feb000a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feb10006fd0 tx=0x7feb10008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.186+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb0c09bd40 con 0x7feb18101420 2024-09-19T09:01:39.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.356+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb18109010 con 0x7feb18101420 2024-09-19T09:01:39.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.359+0000 7feb1c9d3640 1 -- 172.21.15.83:0/189884845 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24576 (secure 0 0 0) 0x7feb0c097070 con 0x7feb18101420 2024-09-19T09:01:39.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:01:39.359 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":87,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:00:46.806423+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7feb000a3350 msgr2=0x7feb000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7feb000a3350 0x7feb000a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feb10006fd0 tx=0x7feb10008040 comp rx=0 tx=0).stop 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 msgr2=0x7feb181998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb181998a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00b4a0 tx=0x7feb0c00b960 comp rx=0 tx=0).stop 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 shutdown_connections 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7feb000a3350 0x7feb000a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb18106a80 0x7feb181a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb18101420 0x7feb181998a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 --2- 172.21.15.83:0/189884845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb18100a80 0x7feb18199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 >> 172.21.15.83:0/189884845 conn(0x7feb180fc7a0 msgr2=0x7feb180fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 shutdown_connections 2024-09-19T09:01:39.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:39.361+0000 7feb1d9d5640 1 -- 172.21.15.83:0/189884845 wait complete. 2024-09-19T09:01:39.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:39 smithi083 ceph-mon[30926]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-19T09:01:39.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:39 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/189884845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:39.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:39 smithi184 ceph-mon[35007]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-19T09:01:39.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:39 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/189884845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:39.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:39 smithi122 ceph-mon[34247]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-19T09:01:39.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:39 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/189884845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:40.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:01:40.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:01:40.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:01:40.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:01:40.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:01:40.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:01:40.081 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:01:40.081 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:01:40.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:01:40.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:01:40.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:01:40.083 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:01:40.815 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.834 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.834 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.838 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.838 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.843 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.843 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.845 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.846 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.857 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:41.144 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 -- 172.21.15.83:0/3656900479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec101de0 msgr2=0x7f5dec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 --2- 172.21.15.83:0/3656900479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec101de0 0x7f5dec1021c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009900 tx=0x7f5ddc02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 -- 172.21.15.83:0/3656900479 shutdown_connections 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 --2- 172.21.15.83:0/3656900479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dec106f10 0x7f5dec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 --2- 172.21.15.83:0/3656900479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dec102790 0x7f5dec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 --2- 172.21.15.83:0/3656900479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec101de0 0x7f5dec1021c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 -- 172.21.15.83:0/3656900479 >> 172.21.15.83:0/3656900479 conn(0x7f5dec0fd8c0 msgr2=0x7f5dec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 -- 172.21.15.83:0/3656900479 shutdown_connections 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.091+0000 7f5df1128640 1 -- 172.21.15.83:0/3656900479 wait complete. 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 Processor -- start 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 -- start start 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dec101de0 0x7f5dec19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dec102790 0x7f5dec19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec106f10 0x7f5dec19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec111e20 con 0x7f5dec106f10 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec111ca0 con 0x7f5dec101de0 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.092+0000 7f5df1128640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec111fa0 con 0x7f5dec102790 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec106f10 0x7f5dec19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec106f10 0x7f5dec19ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60932/0 (socket says 172.21.15.83:60932) 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 -- 172.21.15.83:0/1246144365 learned_addr learned my addr 172.21.15.83:0/1246144365 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5dead9d640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dec101de0 0x7f5dec19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5dea59c640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dec102790 0x7f5dec19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 -- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dec102790 msgr2=0x7f5dec19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dec102790 0x7f5dec19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 -- 172.21.15.83:0/1246144365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dec101de0 msgr2=0x7f5dec19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dec101de0 0x7f5dec19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 -- 172.21.15.83:0/1246144365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec19f500 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5deb59e640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec106f10 0x7f5dec19ee20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5de400cce0 tx=0x7f5de400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de400f450 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec19f7f0 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5de400faa0 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4018b70 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.093+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec1a70d0 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.094+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5dec10e0d0 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.095+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5de4018d10 con 0x7f5dec106f10 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dd3fff640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5dd40a32d0 0x7f5dd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dead9d640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5dd40a32d0 0x7f5dd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7f5de40d04c0 con 0x7f5dec106f10 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dd3fff640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] conn(0x7f5dd40ae2a0 0x7f5dd40b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 --> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5de4015e70 con 0x7f5dd40ae2a0 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f5de40d08f0 con 0x7f5dec106f10 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.096+0000 7f5dead9d640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5dd40a32d0 0x7f5dd40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc031440 tx=0x7f5ddc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.097+0000 7f5dea59c640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] conn(0x7f5dd40ae2a0 0x7f5dd40b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.097+0000 7f5dea59c640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] conn(0x7f5dd40ae2a0 0x7f5dd40b0740 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:42.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.098+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== osd.5 v2:172.21.15.184:6808/2450970045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5de4015e70 con 0x7f5dd40ae2a0 2024-09-19T09:01:42.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.111+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 --> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5dec1032c0 con 0x7f5dd40ae2a0 2024-09-19T09:01:42.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.112+0000 7f5dd3fff640 1 -- 172.21.15.83:0/1246144365 <== osd.5 v2:172.21.15.184:6808/2450970045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5dec1032c0 con 0x7f5dd40ae2a0 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.112+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] conn(0x7f5dd40ae2a0 msgr2=0x7f5dd40b0740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.112+0000 7f5df1128640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] conn(0x7f5dd40ae2a0 0x7f5dd40b0740 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.112+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5dd40a32d0 msgr2=0x7f5dd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5dd40a32d0 0x7f5dd40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc031440 tx=0x7f5ddc0095f0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec106f10 msgr2=0x7f5dec19ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 --2- 172.21.15.83:0/1246144365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dec106f10 0x7f5dec19ee20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5de400cce0 tx=0x7f5de400a620 comp rx=0 tx=0).stop 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5deb59e640 1 -- 172.21.15.83:0/1246144365 reap_dead start 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 shutdown_connections 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 >> 172.21.15.83:0/1246144365 conn(0x7f5dec0fd8c0 msgr2=0x7f5dec0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 shutdown_connections 2024-09-19T09:01:42.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.113+0000 7f5df1128640 1 -- 172.21.15.83:0/1246144365 wait complete. 2024-09-19T09:01:42.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:41 smithi083 ceph-mon[30926]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.291+0000 7fe51a0a9640 1 -- 172.21.15.83:0/3519904303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 msgr2=0x7fe51410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.291+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/3519904303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe51410da40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009ca0 tx=0x7fe50c02a950 comp rx=0 tx=0).stop 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.291+0000 7fe51a0a9640 1 -- 172.21.15.83:0/3519904303 shutdown_connections 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/3519904303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe51410da40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/3519904303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe514102570 0x7fe5141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/3519904303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe514100e20 0x7fe514101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- 172.21.15.83:0/3519904303 >> 172.21.15.83:0/3519904303 conn(0x7fe5140fc7d0 msgr2=0x7fe5140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- 172.21.15.83:0/3519904303 shutdown_connections 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- 172.21.15.83:0/3519904303 wait complete. 2024-09-19T09:01:42.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 Processor -- start 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- start start 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe514100e20 0x7fe514196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe514102570 0x7fe5141974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe5141979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe514110e30 con 0x7fe514102ef0 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe514110cb0 con 0x7fe514100e20 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe51a0a9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe514110fb0 con 0x7fe514102570 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.292+0000 7fe513fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe5141979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe5141979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60954/0 (socket says 172.21.15.83:60954) 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 -- 172.21.15.83:0/856808502 learned_addr learned my addr 172.21.15.83:0/856808502 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:42.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe5137fe640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe514100e20 0x7fe514196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe50bfff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe514102570 0x7fe5141974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 -- 172.21.15.83:0/856808502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe514102570 msgr2=0x7fe5141974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe514102570 0x7fe5141974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 -- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe514100e20 msgr2=0x7fe514196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe514100e20 0x7fe514196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 -- 172.21.15.83:0/856808502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5141a67e0 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe50bfff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe514102570 0x7fe5141974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe513fff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe5141979f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe50c006010 tx=0x7fe50c02f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c034040 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe50c003e00 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5141a6a70 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c045480 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.293+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5141a6f50 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.294+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5141072a0 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe50c037020 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5117fa640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5000a32d0 0x7fe5000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5137fe640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5000a32d0 0x7fe5000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fe50c0f0f20 con 0x7fe514102ef0 2024-09-19T09:01:42.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5117fa640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] conn(0x7fe5000ae2a0 0x7fe5000b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 --> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5000b0e10 con 0x7fe5000ae2a0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.296+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe50c0f1350 con 0x7fe514102ef0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.297+0000 7fe5137fe640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5000a32d0 0x7fe5000a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe5040058c0 tx=0x7fe50400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.297+0000 7fe50bfff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] conn(0x7fe5000ae2a0 0x7fe5000b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.297+0000 7fe50bfff640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] conn(0x7fe5000ae2a0 0x7fe5000b0740 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.298+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== osd.1 v2:172.21.15.122:6800/3677858839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5000b0e10 con 0x7fe5000ae2a0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.311+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 --> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5141021b0 con 0x7fe5000ae2a0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe5117fa640 1 -- 172.21.15.83:0/856808502 <== osd.1 v2:172.21.15.122:6800/3677858839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5141021b0 con 0x7fe5000ae2a0 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] conn(0x7fe5000ae2a0 msgr2=0x7fe5000b0740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] conn(0x7fe5000ae2a0 0x7fe5000b0740 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5000a32d0 msgr2=0x7fe5000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5000a32d0 0x7fe5000a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe5040058c0 tx=0x7fe50400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 msgr2=0x7fe5141979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:42.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe51a0a9640 1 --2- 172.21.15.83:0/856808502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe514102ef0 0x7fe5141979f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe50c006010 tx=0x7fe50c02f710 comp rx=0 tx=0).stop 2024-09-19T09:01:42.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.312+0000 7fe513fff640 1 -- 172.21.15.83:0/856808502 reap_dead start 2024-09-19T09:01:42.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.313+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 shutdown_connections 2024-09-19T09:01:42.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.313+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 >> 172.21.15.83:0/856808502 conn(0x7fe5140fc7d0 msgr2=0x7fe514106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:42.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.313+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 shutdown_connections 2024-09-19T09:01:42.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:42.313+0000 7fe51a0a9640 1 -- 172.21.15.83:0/856808502 wait complete. 2024-09-19T09:01:42.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:41 smithi184 ceph-mon[35007]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-19T09:01:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:41 smithi122 ceph-mon[34247]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-19T09:01:43.078 INFO:teuthology.orchestra.run.smithi083.stdout:51539607630 2024-09-19T09:01:43.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:01:43.707 INFO:teuthology.orchestra.run.smithi083.stdout:154618822713 2024-09-19T09:01:43.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:01:43.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.962+0000 7fc49c48e640 1 -- 172.21.15.83:0/771271677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494101420 msgr2=0x7fc49410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.962+0000 7fc49c48e640 1 --2- 172.21.15.83:0/771271677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494101420 0x7fc49410d950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009cd0 tx=0x7fc48c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- 172.21.15.83:0/771271677 shutdown_connections 2024-09-19T09:01:43.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 --2- 172.21.15.83:0/771271677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494101420 0x7fc49410d950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 --2- 172.21.15.83:0/771271677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc494100a80 0x7fc494100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 --2- 172.21.15.83:0/771271677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc494106a80 0x7fc494106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- 172.21.15.83:0/771271677 >> 172.21.15.83:0/771271677 conn(0x7fc4940fc7a0 msgr2=0x7fc4940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- 172.21.15.83:0/771271677 shutdown_connections 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- 172.21.15.83:0/771271677 wait complete. 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 Processor -- start 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- start start 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494100a80 0x7fc4940fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc494101420 0x7fc4940fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc494106a80 0x7fc4940fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc494110d30 con 0x7fc494100a80 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc494110bb0 con 0x7fc494106a80 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49c48e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc494110eb0 con 0x7fc494101420 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.963+0000 7fc49a22a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494100a80 0x7fc4940fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494100a80 0x7fc4940fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60986/0 (socket says 172.21.15.83:60986) 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 -- 172.21.15.83:0/2574920295 learned_addr learned my addr 172.21.15.83:0/2574920295 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49aa2b640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc494106a80 0x7fc4940fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc499a29640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc494101420 0x7fc4940fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 -- 172.21.15.83:0/2574920295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc494101420 msgr2=0x7fc4940fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc494101420 0x7fc4940fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 -- 172.21.15.83:0/2574920295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc494106a80 msgr2=0x7fc4940fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc494106a80 0x7fc4940fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 -- 172.21.15.83:0/2574920295 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4941a6720 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49aa2b640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc494106a80 0x7fc4940fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc499a29640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc494101420 0x7fc4940fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49a22a640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494100a80 0x7fc4940fcde0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c970 tx=0x7fc49000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490007bb0 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4941a6a10 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc490007d50 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49000f450 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.964+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941a6f50 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.965+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4940628c0 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.966+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc490004f00 con 0x7fc494100a80 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc4877fe640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4800a3350 0x7fc4800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc499a29640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4800a3350 0x7fc4800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8976+0+0 (secure 0 0 0) 0x7fc4900cfe90 con 0x7fc494100a80 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc4877fe640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] conn(0x7fc4800ae320 0x7fc4800b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 --> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4800b0e90 con 0x7fc4800ae320 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc4900d02c0 con 0x7fc494100a80 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc49aa2b640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] conn(0x7fc4800ae320 0x7fc4800b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.967+0000 7fc499a29640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4800a3350 0x7fc4800a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc4940fe870 tx=0x7fc488005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.968+0000 7fc49aa2b640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] conn(0x7fc4800ae320 0x7fc4800b07c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.968+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== osd.6 v2:172.21.15.83:6818/1892974872 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4800b0e90 con 0x7fc4800ae320 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 --> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc494062d40 con 0x7fc4800ae320 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc4877fe640 1 -- 172.21.15.83:0/2574920295 <== osd.6 v2:172.21.15.83:6818/1892974872 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc494062d40 con 0x7fc4800ae320 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] conn(0x7fc4800ae320 msgr2=0x7fc4800b07c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] conn(0x7fc4800ae320 0x7fc4800b07c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4800a3350 msgr2=0x7fc4800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc4800a3350 0x7fc4800a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc4940fe870 tx=0x7fc488005d90 comp rx=0 tx=0).stop 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494100a80 msgr2=0x7fc4940fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49c48e640 1 --2- 172.21.15.83:0/2574920295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc494100a80 0x7fc4940fcde0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c970 tx=0x7fc49000ce30 comp rx=0 tx=0).stop 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.982+0000 7fc49aa2b640 1 -- 172.21.15.83:0/2574920295 reap_dead start 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.983+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 shutdown_connections 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.983+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 >> 172.21.15.83:0/2574920295 conn(0x7fc4940fc7a0 msgr2=0x7fc49406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.983+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 shutdown_connections 2024-09-19T09:01:43.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:43.983+0000 7fc49c48e640 1 -- 172.21.15.83:0/2574920295 wait complete. 2024-09-19T09:01:44.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:43 smithi083 ceph-mon[30926]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:01:44.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]: dispatch 2024-09-19T09:01:44.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-19T09:01:44.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T09:01:44.336 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:43 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-09-19T09:01:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:43 smithi184 ceph-mon[35007]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:01:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]: dispatch 2024-09-19T09:01:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-19T09:01:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T09:01:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:43 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-09-19T09:01:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:43 smithi122 ceph-mon[34247]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:01:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]: dispatch 2024-09-19T09:01:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-19T09:01:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T09:01:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:43 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-09-19T09:01:45.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 -- 172.21.15.83:0/3046836819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0106a80 msgr2=0x7f62a0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 --2- 172.21.15.83:0/3046836819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0106a80 0x7f62a0106e60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6294009930 tx=0x7f629402a420 comp rx=0 tx=0).stop 2024-09-19T09:01:45.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 -- 172.21.15.83:0/3046836819 shutdown_connections 2024-09-19T09:01:45.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 --2- 172.21.15.83:0/3046836819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a0101420 0x7f62a010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 --2- 172.21.15.83:0/3046836819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a0100a80 0x7f62a0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 --2- 172.21.15.83:0/3046836819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0106a80 0x7f62a0106e60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 -- 172.21.15.83:0/3046836819 >> 172.21.15.83:0/3046836819 conn(0x7f62a00fc7a0 msgr2=0x7f62a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 -- 172.21.15.83:0/3046836819 shutdown_connections 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.050+0000 7f62a6acd640 1 -- 172.21.15.83:0/3046836819 wait complete. 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 Processor -- start 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 -- start start 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a0100a80 0x7f62a0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0101420 0x7f62a0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a0106a80 0x7f62a019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0110d50 con 0x7f62a0101420 2024-09-19T09:01:45.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0110bd0 con 0x7f62a0106a80 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a6acd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0110ed0 con 0x7f62a0100a80 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0101420 0x7f62a0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0101420 0x7f62a0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32778/0 (socket says 172.21.15.83:32778) 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 -- 172.21.15.83:0/1238323022 learned_addr learned my addr 172.21.15.83:0/1238323022 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a4869640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a0100a80 0x7f62a0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f62a506a640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a0106a80 0x7f62a019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 -- 172.21.15.83:0/1238323022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a0100a80 msgr2=0x7f62a0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a0100a80 0x7f62a0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 -- 172.21.15.83:0/1238323022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a0106a80 msgr2=0x7f62a019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62a0106a80 0x7f62a019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 -- 172.21.15.83:0/1238323022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a019d3e0 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.051+0000 7f629ffff640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0101420 0x7f62a0198970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f628c00b4a0 tx=0x7f628c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.052+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c014070 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.052+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f628c010ac0 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.052+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a019d6d0 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.052+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c017c30 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.052+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a01a4fb0 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.053+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62a00fd140 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.054+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f628c017070 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.054+0000 7f629dffb640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f62900a32d0 0x7f62900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.054+0000 7f62a4869640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f62900a32d0 0x7f62900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.054+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f628c0cf530 con 0x7f62a0101420 2024-09-19T09:01:45.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.055+0000 7f629dffb640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] conn(0x7f62900ae4a0 0x7f62900b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.055+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 --> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f628c00ee50 con 0x7f62900ae4a0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.055+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f628c0cf980 con 0x7f62a0101420 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.055+0000 7f62a506a640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] conn(0x7f62900ae4a0 0x7f62900b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.055+0000 7f62a4869640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f62900a32d0 0x7f62900a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6294000c00 tx=0x7f6294031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.055+0000 7f62a506a640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] conn(0x7f62900ae4a0 0x7f62900b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.056+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== osd.0 v2:172.21.15.83:6802/2608393780 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f628c00ee50 con 0x7f62900ae4a0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.069+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 --> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f62a01021c0 con 0x7f62900ae4a0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.069+0000 7f629dffb640 1 -- 172.21.15.83:0/1238323022 <== osd.0 v2:172.21.15.83:6802/2608393780 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f62a01021c0 con 0x7f62900ae4a0 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] conn(0x7f62900ae4a0 msgr2=0x7f62900b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] conn(0x7f62900ae4a0 0x7f62900b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f62900a32d0 msgr2=0x7f62900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f62900a32d0 0x7f62900a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6294000c00 tx=0x7f6294031400 comp rx=0 tx=0).stop 2024-09-19T09:01:45.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0101420 msgr2=0x7f62a0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 --2- 172.21.15.83:0/1238323022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62a0101420 0x7f62a0198970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f628c00b4a0 tx=0x7f628c00b960 comp rx=0 tx=0).stop 2024-09-19T09:01:45.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a506a640 1 -- 172.21.15.83:0/1238323022 reap_dead start 2024-09-19T09:01:45.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 shutdown_connections 2024-09-19T09:01:45.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 >> 172.21.15.83:0/1238323022 conn(0x7f62a00fc7a0 msgr2=0x7f62a0104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 shutdown_connections 2024-09-19T09:01:45.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.070+0000 7f62a6acd640 1 -- 172.21.15.83:0/1238323022 wait complete. 2024-09-19T09:01:45.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-19T09:01:45.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-19T09:01:45.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T09:01:45.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:44 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-09-19T09:01:45.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:44 smithi083 ceph-mon[30926]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:01:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-19T09:01:45.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-19T09:01:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T09:01:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:44 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-09-19T09:01:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:44 smithi184 ceph-mon[35007]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:01:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-19T09:01:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-19T09:01:45.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T09:01:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:44 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-09-19T09:01:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:44 smithi122 ceph-mon[34247]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:01:45.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 -- 172.21.15.83:0/1364572571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10102790 msgr2=0x7fad101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 --2- 172.21.15.83:0/1364572571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10102790 0x7fad101067e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7facf8009900 tx=0x7facf802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 -- 172.21.15.83:0/1364572571 shutdown_connections 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 --2- 172.21.15.83:0/1364572571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10106f10 0x7fad1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 --2- 172.21.15.83:0/1364572571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10102790 0x7fad101067e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 --2- 172.21.15.83:0/1364572571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad10101de0 0x7fad101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 -- 172.21.15.83:0/1364572571 >> 172.21.15.83:0/1364572571 conn(0x7fad100fd8e0 msgr2=0x7fad100ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 -- 172.21.15.83:0/1364572571 shutdown_connections 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 -- 172.21.15.83:0/1364572571 wait complete. 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 Processor -- start 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.478+0000 7fad16a47640 1 -- start start 2024-09-19T09:01:45.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10101de0 0x7fad100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad10102790 0x7fad10074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10106f10 0x7fad10074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fad10111ec0 con 0x7fad10106f10 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad10111d40 con 0x7fad10102790 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad10112040 con 0x7fad10101de0 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10106f10 0x7fad10074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10106f10 0x7fad10074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32802/0 (socket says 172.21.15.83:32802) 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 -- 172.21.15.83:0/921406770 learned_addr learned my addr 172.21.15.83:0/921406770 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad07fff640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad10102790 0x7fad10074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad0ffff640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10101de0 0x7fad100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 -- 172.21.15.83:0/921406770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10101de0 msgr2=0x7fad100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10101de0 0x7fad100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 -- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad10102790 msgr2=0x7fad10074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad10102790 0x7fad10074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 -- 172.21.15.83:0/921406770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad101a6980 con 0x7fad10106f10 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad14fe4640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10106f10 0x7fad10074f70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad0800b970 tx=0x7fad0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08019070 con 0x7fad10106f10 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad08014440 con 0x7fad10106f10 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad101a6c70 con 0x7fad10106f10 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.479+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad080075d0 con 0x7fad10106f10 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.480+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad101a7130 con 0x7fad10106f10 2024-09-19T09:01:45.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.480+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad10062880 con 0x7fad10106f10 2024-09-19T09:01:45.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.482+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fad0801c070 con 0x7fad10106f10 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.482+0000 7fad0dffb640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7facfc0a32d0 0x7facfc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.482+0000 7fad0ffff640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7facfc0a32d0 0x7facfc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.483+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fad080cfa80 con 0x7fad10106f10 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.483+0000 7fad0dffb640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] conn(0x7facfc0ae4a0 0x7facfc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.483+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 --> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad080047d0 con 0x7facfc0ae4a0 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.483+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fad080cfed0 con 0x7fad10106f10 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.483+0000 7fad0ffff640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7facfc0a32d0 0x7facfc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad00009890 tx=0x7fad00008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.483+0000 7fad07fff640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] conn(0x7facfc0ae4a0 0x7facfc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.484+0000 7fad07fff640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] conn(0x7facfc0ae4a0 0x7facfc0b0940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.484+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== osd.10 v2:172.21.15.122:6824/2508026961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad080047d0 con 0x7facfc0ae4a0 2024-09-19T09:01:45.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 --> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad10062c80 con 0x7facfc0ae4a0 2024-09-19T09:01:45.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad0dffb640 1 -- 172.21.15.83:0/921406770 <== osd.10 v2:172.21.15.122:6824/2508026961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad10062c80 con 0x7facfc0ae4a0 2024-09-19T09:01:45.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] conn(0x7facfc0ae4a0 msgr2=0x7facfc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad16a47640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] conn(0x7facfc0ae4a0 0x7facfc0b0940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7facfc0a32d0 msgr2=0x7facfc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad16a47640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7facfc0a32d0 0x7facfc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad00009890 tx=0x7fad00008040 comp rx=0 tx=0).stop 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.498+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10106f10 msgr2=0x7fad10074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.499+0000 7fad16a47640 1 --2- 172.21.15.83:0/921406770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10106f10 0x7fad10074f70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad0800b970 tx=0x7fad0800be30 comp rx=0 tx=0).stop 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.499+0000 7fad14fe4640 1 -- 172.21.15.83:0/921406770 reap_dead start 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.499+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 shutdown_connections 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.499+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 >> 172.21.15.83:0/921406770 conn(0x7fad100fd8e0 msgr2=0x7fad100fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.499+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 shutdown_connections 2024-09-19T09:01:45.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:45.499+0000 7fad16a47640 1 -- 172.21.15.83:0/921406770 wait complete. 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 -- 172.21.15.83:0/1451589014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c101de0 msgr2=0x7f2b8c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 --2- 172.21.15.83:0/1451589014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c101de0 0x7f2b8c1021c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009ca0 tx=0x7f2b7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 -- 172.21.15.83:0/1451589014 shutdown_connections 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 --2- 172.21.15.83:0/1451589014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c106f10 0x7f2b8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 --2- 172.21.15.83:0/1451589014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b8c102790 0x7f2b8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 --2- 172.21.15.83:0/1451589014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c101de0 0x7f2b8c1021c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 -- 172.21.15.83:0/1451589014 >> 172.21.15.83:0/1451589014 conn(0x7f2b8c0fd8c0 msgr2=0x7f2b8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 -- 172.21.15.83:0/1451589014 shutdown_connections 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.424+0000 7f2b91751640 1 -- 172.21.15.83:0/1451589014 wait complete. 2024-09-19T09:01:45.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 Processor -- start 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 -- start start 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b8c101de0 0x7f2b8c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c102790 0x7f2b8c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c106f10 0x7f2b8c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c111e40 con 0x7f2b8c102790 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c111cc0 con 0x7f2b8c101de0 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b91751640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c111fc0 con 0x7f2b8c106f10 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c102790 0x7f2b8c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c102790 0x7f2b8c1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32770/0 (socket says 172.21.15.83:32770) 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 -- 172.21.15.83:0/2854012947 learned_addr learned my addr 172.21.15.83:0/2854012947 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:45.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8affd640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b8c101de0 0x7f2b8c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 -- 172.21.15.83:0/2854012947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c106f10 msgr2=0x7f2b8c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c106f10 0x7f2b8c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 -- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b8c101de0 msgr2=0x7f2b8c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b8c101de0 0x7f2b8c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.425+0000 7f2b8a7fc640 1 -- 172.21.15.83:0/2854012947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c19d310 con 0x7f2b8c102790 2024-09-19T09:01:45.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.426+0000 7f2b8a7fc640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c102790 0x7f2b8c1988a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c920 tx=0x7f2b7400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.426+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74007c70 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.426+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b74007e10 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.426+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c19d600 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.426+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74018820 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.426+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c1a4ee0 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.427+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b8c062940 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.428+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b740189c0 con 0x7f2b8c102790 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b83fff640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b780a32d0 0x7f2b780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b8affd640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b780a32d0 0x7f2b780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f2b740d0450 con 0x7f2b8c102790 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b83fff640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] conn(0x7f2b780ae4a0 0x7f2b780b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 --> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b74015e70 con 0x7f2b780ae4a0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f2b740d08a0 con 0x7f2b8c102790 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b8affd640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b780a32d0 0x7f2b780a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c006010 tx=0x7f2b7c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.429+0000 7f2b8b7fe640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] conn(0x7f2b780ae4a0 0x7f2b780b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.430+0000 7f2b8b7fe640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] conn(0x7f2b780ae4a0 0x7f2b780b0940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.431+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== osd.4 v2:172.21.15.122:6808/2534293104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b74015e70 con 0x7f2b780ae4a0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.444+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 --> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b8c062dc0 con 0x7f2b780ae4a0 2024-09-19T09:01:45.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.444+0000 7f2b83fff640 1 -- 172.21.15.83:0/2854012947 <== osd.4 v2:172.21.15.122:6808/2534293104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2b8c062dc0 con 0x7f2b780ae4a0 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.444+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] conn(0x7f2b780ae4a0 msgr2=0x7f2b780b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.444+0000 7f2b91751640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] conn(0x7f2b780ae4a0 0x7f2b780b0940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b780a32d0 msgr2=0x7f2b780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f2b780a32d0 0x7f2b780a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c006010 tx=0x7f2b7c000f40 comp rx=0 tx=0).stop 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c102790 msgr2=0x7f2b8c1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 --2- 172.21.15.83:0/2854012947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b8c102790 0x7f2b8c1988a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c920 tx=0x7f2b7400cde0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b8b7fe640 1 -- 172.21.15.83:0/2854012947 reap_dead start 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 shutdown_connections 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 >> 172.21.15.83:0/2854012947 conn(0x7f2b8c0fd8c0 msgr2=0x7f2b8c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 shutdown_connections 2024-09-19T09:01:45.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:44.445+0000 7f2b91751640 1 -- 172.21.15.83:0/2854012947 wait complete. 2024-09-19T09:01:46.347 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:45 smithi083 ceph-mon[30926]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T09:01:46.347 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:45 smithi083 ceph-mon[30926]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:01:46.347 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:45 smithi083 ceph-mon[30926]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T09:01:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:45 smithi184 ceph-mon[35007]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T09:01:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:45 smithi184 ceph-mon[35007]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:01:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:45 smithi184 ceph-mon[35007]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T09:01:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:45 smithi122 ceph-mon[34247]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T09:01:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:45 smithi122 ceph-mon[34247]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:01:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:45 smithi122 ceph-mon[34247]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T09:01:46.595 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:46.600 INFO:teuthology.orchestra.run.smithi083.stdout:128849018942 2024-09-19T09:01:46.600 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:01:47.283 INFO:teuthology.orchestra.run.smithi083.stdout:34359738451 2024-09-19T09:01:47.283 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:01:47.734 INFO:teuthology.orchestra.run.smithi083.stdout:292057776161 2024-09-19T09:01:47.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:01:48.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 -- 172.21.15.83:0/4248100175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00108300 msgr2=0x7fdb0010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 --2- 172.21.15.83:0/4248100175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00108300 0x7fdb0010ec70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009cd0 tx=0x7fdaf802a8d0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 -- 172.21.15.83:0/4248100175 shutdown_connections 2024-09-19T09:01:48.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 --2- 172.21.15.83:0/4248100175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00108300 0x7fdb0010ec70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 --2- 172.21.15.83:0/4248100175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb00103780 0x7fdb00107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 --2- 172.21.15.83:0/4248100175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb00102dd0 0x7fdb001031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 -- 172.21.15.83:0/4248100175 >> 172.21.15.83:0/4248100175 conn(0x7fdb000fc7d0 msgr2=0x7fdb000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 -- 172.21.15.83:0/4248100175 shutdown_connections 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.211+0000 7fdb05afe640 1 -- 172.21.15.83:0/4248100175 wait complete. 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 Processor -- start 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 -- start start 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb00102dd0 0x7fdb00198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00103780 0x7fdb00198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb00108300 0x7fdb0019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00111fe0 con 0x7fdb00103780 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00111e60 con 0x7fdb00108300 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdb05afe640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00112160 con 0x7fdb00102dd0 2024-09-19T09:01:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdafeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00103780 0x7fdb00198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdafeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00103780 0x7fdb00198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32812/0 (socket says 172.21.15.83:32812) 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdafeffd640 1 -- 172.21.15.83:0/768728030 learned_addr learned my addr 172.21.15.83:0/768728030 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdaff7fe640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb00102dd0 0x7fdb00198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.212+0000 7fdafffff640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb00108300 0x7fdb0019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafeffd640 1 -- 172.21.15.83:0/768728030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb00102dd0 msgr2=0x7fdb00198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafeffd640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb00102dd0 0x7fdb00198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafeffd640 1 -- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb00108300 msgr2=0x7fdb0019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafeffd640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb00108300 0x7fdb0019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafeffd640 1 -- 172.21.15.83:0/768728030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0019d4d0 con 0x7fdb00103780 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafffff640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb00108300 0x7fdb0019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafeffd640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00103780 0x7fdb00198a60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d750 tx=0x7fdaf400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4017070 con 0x7fdb00103780 2024-09-19T09:01:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaf4009820 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0019d7c0 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4004c40 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.213+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb001a50a0 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.214+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb00062980 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.215+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdaf40099d0 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdafcff9640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fdae80a3350 0x7fdae80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdaff7fe640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fdae80a3350 0x7fdae80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fdaf40cfa90 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdafcff9640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] conn(0x7fdae80ae520 0x7fdae80b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 --> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaf4001d30 con 0x7fdae80ae520 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fdaf40cfee0 con 0x7fdb00103780 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdaff7fe640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fdae80a3350 0x7fdae80a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009990 tx=0x7fdaf0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.216+0000 7fdafffff640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] conn(0x7fdae80ae520 0x7fdae80b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.217+0000 7fdafffff640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] conn(0x7fdae80ae520 0x7fdae80b09c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.218+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== osd.7 v2:172.21.15.122:6816/1549732923 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdaf4001d30 con 0x7fdae80ae520 2024-09-19T09:01:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.231+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 --> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdb00062e00 con 0x7fdae80ae520 2024-09-19T09:01:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdafcff9640 1 -- 172.21.15.83:0/768728030 <== osd.7 v2:172.21.15.122:6816/1549732923 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdb00062e00 con 0x7fdae80ae520 2024-09-19T09:01:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] conn(0x7fdae80ae520 msgr2=0x7fdae80b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] conn(0x7fdae80ae520 0x7fdae80b09c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fdae80a3350 msgr2=0x7fdae80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fdae80a3350 0x7fdae80a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009990 tx=0x7fdaf0009110 comp rx=0 tx=0).stop 2024-09-19T09:01:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00103780 msgr2=0x7fdb00198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 --2- 172.21.15.83:0/768728030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb00103780 0x7fdb00198a60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d750 tx=0x7fdaf400db50 comp rx=0 tx=0).stop 2024-09-19T09:01:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdafffff640 1 -- 172.21.15.83:0/768728030 reap_dead start 2024-09-19T09:01:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 shutdown_connections 2024-09-19T09:01:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.232+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 >> 172.21.15.83:0/768728030 conn(0x7fdb000fc7d0 msgr2=0x7fdb00105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.233+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 shutdown_connections 2024-09-19T09:01:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.233+0000 7fdb05afe640 1 -- 172.21.15.83:0/768728030 wait complete. 2024-09-19T09:01:48.235 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:48 smithi083 ceph-mon[30926]: pgmap v321: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 11 op/s 2024-09-19T09:01:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:48 smithi184 ceph-mon[35007]: pgmap v321: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 11 op/s 2024-09-19T09:01:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:48 smithi122 ceph-mon[34247]: pgmap v321: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 11 op/s 2024-09-19T09:01:48.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 -- 172.21.15.83:0/3174924703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102ef0 msgr2=0x7ffaec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/3174924703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102ef0 0x7ffaec10da40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009900 tx=0x7ffae402a480 comp rx=0 tx=0).stop 2024-09-19T09:01:48.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 -- 172.21.15.83:0/3174924703 shutdown_connections 2024-09-19T09:01:48.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/3174924703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102ef0 0x7ffaec10da40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/3174924703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec102570 0x7ffaec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/3174924703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec100e20 0x7ffaec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.636+0000 7ffaf41ba640 1 -- 172.21.15.83:0/3174924703 >> 172.21.15.83:0/3174924703 conn(0x7ffaec0fc7d0 msgr2=0x7ffaec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 -- 172.21.15.83:0/3174924703 shutdown_connections 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 -- 172.21.15.83:0/3174924703 wait complete. 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 Processor -- start 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 -- start start 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec100e20 0x7ffaec1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102570 0x7ffaec1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec102ef0 0x7ffaec19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec110e50 con 0x7ffaec102570 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec110cd0 con 0x7ffaec100e20 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf41ba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec110fd0 con 0x7ffaec102ef0 2024-09-19T09:01:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.637+0000 7ffaf1755640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102570 0x7ffaec1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102570 0x7ffaec1978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32832/0 (socket says 172.21.15.83:32832) 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 -- 172.21.15.83:0/1907973115 learned_addr learned my addr 172.21.15.83:0/1907973115 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1f56640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec100e20 0x7ffaec1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 -- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec102ef0 msgr2=0x7ffaec19bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec102ef0 0x7ffaec19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 -- 172.21.15.83:0/1907973115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec100e20 msgr2=0x7ffaec1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffaec100e20 0x7ffaec1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 -- 172.21.15.83:0/1907973115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec19c360 con 0x7ffaec102570 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf1755640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102570 0x7ffaec1978f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffae000d950 tx=0x7ffae000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0017070 con 0x7ffaec102570 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec19c650 con 0x7ffaec102570 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae0009c30 con 0x7ffaec102570 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae000f620 con 0x7ffaec102570 2024-09-19T09:01:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.638+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec1a3f30 con 0x7ffaec102570 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.639+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffaec062980 con 0x7ffaec102570 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.640+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffae00109a0 con 0x7ffaec102570 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.641+0000 7ffaeaffd640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffad40a32d0 0x7ffad40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.641+0000 7ffaf1f56640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffad40a32d0 0x7ffad40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.641+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ffae00cfdd0 con 0x7ffaec102570 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.641+0000 7ffaeaffd640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] conn(0x7ffad40ae4a0 0x7ffad40b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.641+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 --> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffad40b1010 con 0x7ffad40ae4a0 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.641+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ffae00d0220 con 0x7ffaec102570 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.642+0000 7ffaf1f56640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffad40a32d0 0x7ffad40a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00a400 tx=0x7ffadc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.642+0000 7ffaf2757640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] conn(0x7ffad40ae4a0 0x7ffad40b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.642+0000 7ffaf2757640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] conn(0x7ffad40ae4a0 0x7ffad40b0940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.643+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== osd.8 v2:172.21.15.184:6816/1048154265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffad40b1010 con 0x7ffad40ae4a0 2024-09-19T09:01:48.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.657+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 --> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffaec062d80 con 0x7ffad40ae4a0 2024-09-19T09:01:48.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.657+0000 7ffaeaffd640 1 -- 172.21.15.83:0/1907973115 <== osd.8 v2:172.21.15.184:6816/1048154265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffaec062d80 con 0x7ffad40ae4a0 2024-09-19T09:01:48.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] conn(0x7ffad40ae4a0 msgr2=0x7ffad40b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] conn(0x7ffad40ae4a0 0x7ffad40b0940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffad40a32d0 msgr2=0x7ffad40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ffad40a32d0 0x7ffad40a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00a400 tx=0x7ffadc00d040 comp rx=0 tx=0).stop 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102570 msgr2=0x7ffaec1978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 --2- 172.21.15.83:0/1907973115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffaec102570 0x7ffaec1978f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffae000d950 tx=0x7ffae000de10 comp rx=0 tx=0).stop 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf2757640 1 -- 172.21.15.83:0/1907973115 reap_dead start 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 shutdown_connections 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 >> 172.21.15.83:0/1907973115 conn(0x7ffaec0fc7d0 msgr2=0x7ffaec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 shutdown_connections 2024-09-19T09:01:48.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:48.658+0000 7ffaf41ba640 1 -- 172.21.15.83:0/1907973115 wait complete. 2024-09-19T09:01:49.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:49 smithi083 ceph-mon[30926]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:01:49.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:49 smithi083 ceph-mon[30926]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-19T09:01:49.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:49 smithi083 ceph-mon[30926]: Cluster is now healthy 2024-09-19T09:01:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:49 smithi184 ceph-mon[35007]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:01:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:49 smithi184 ceph-mon[35007]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-19T09:01:49.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:49 smithi184 ceph-mon[35007]: Cluster is now healthy 2024-09-19T09:01:49.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:49 smithi122 ceph-mon[34247]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:01:49.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:49 smithi122 ceph-mon[34247]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-19T09:01:49.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:49 smithi122 ceph-mon[34247]: Cluster is now healthy 2024-09-19T09:01:49.870 INFO:teuthology.orchestra.run.smithi083.stdout:206158430256 2024-09-19T09:01:49.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:01:50.518 INFO:teuthology.orchestra.run.smithi083.stdout:184683593781 2024-09-19T09:01:50.519 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:01:51.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 -- 172.21.15.83:0/524787532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298106a80 msgr2=0x7fc298106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 --2- 172.21.15.83:0/524787532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298106a80 0x7fc298106e60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc294009930 tx=0x7fc29402a420 comp rx=0 tx=0).stop 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 -- 172.21.15.83:0/524787532 shutdown_connections 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 --2- 172.21.15.83:0/524787532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc298101420 0x7fc29810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 --2- 172.21.15.83:0/524787532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc298100a80 0x7fc298100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 --2- 172.21.15.83:0/524787532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298106a80 0x7fc298106e60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 -- 172.21.15.83:0/524787532 >> 172.21.15.83:0/524787532 conn(0x7fc2980fc7a0 msgr2=0x7fc2980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 -- 172.21.15.83:0/524787532 shutdown_connections 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.028+0000 7fc29fa80640 1 -- 172.21.15.83:0/524787532 wait complete. 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 Processor -- start 2024-09-19T09:01:51.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 -- start start 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc298100a80 0x7fc2981972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298101420 0x7fc298197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc298106a80 0x7fc29819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc298110d30 con 0x7fc298101420 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc298110bb0 con 0x7fc298100a80 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29fa80640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc298110eb0 con 0x7fc298106a80 2024-09-19T09:01:51.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29d01b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298101420 0x7fc298197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29d01b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298101420 0x7fc298197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36992/0 (socket says 172.21.15.83:36992) 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29d01b640 1 -- 172.21.15.83:0/811592322 learned_addr learned my addr 172.21.15.83:0/811592322 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29d81c640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc298100a80 0x7fc2981972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.029+0000 7fc29e01d640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc298106a80 0x7fc29819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29d01b640 1 -- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc298106a80 msgr2=0x7fc29819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29d01b640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc298106a80 0x7fc29819bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29d01b640 1 -- 172.21.15.83:0/811592322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc298100a80 msgr2=0x7fc2981972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29d01b640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc298100a80 0x7fc2981972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29d01b640 1 -- 172.21.15.83:0/811592322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29819c2a0 con 0x7fc298101420 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29d01b640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298101420 0x7fc298197830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc28800d770 tx=0x7fc28800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288017070 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2880054d0 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29819c590 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288004cf0 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.030+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2981a3e70 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.031+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc298062940 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.032+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc288004e90 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc28effd640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2840a3350 0x7fc2840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc29d81c640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2840a3350 0x7fc2840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc2880cfc10 con 0x7fc298101420 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc28effd640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] conn(0x7fc2840ae520 0x7fc2840b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 --> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc288001d30 con 0x7fc2840ae520 2024-09-19T09:01:51.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fc2880d0060 con 0x7fc298101420 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc29d81c640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2840a3350 0x7fc2840a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc294009900 tx=0x7fc294000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.033+0000 7fc29e01d640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] conn(0x7fc2840ae520 0x7fc2840b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.034+0000 7fc29e01d640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] conn(0x7fc2840ae520 0x7fc2840b09c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.035+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== osd.2 v2:172.21.15.184:6800/612727003 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc288001d30 con 0x7fc2840ae520 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.048+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 --> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc298062dc0 con 0x7fc2840ae520 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc28effd640 1 -- 172.21.15.83:0/811592322 <== osd.2 v2:172.21.15.184:6800/612727003 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc298062dc0 con 0x7fc2840ae520 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] conn(0x7fc2840ae520 msgr2=0x7fc2840b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] conn(0x7fc2840ae520 0x7fc2840b09c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2840a3350 msgr2=0x7fc2840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc2840a3350 0x7fc2840a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc294009900 tx=0x7fc294000bc0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298101420 msgr2=0x7fc298197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 --2- 172.21.15.83:0/811592322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc298101420 0x7fc298197830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc28800d770 tx=0x7fc28800dc30 comp rx=0 tx=0).stop 2024-09-19T09:01:51.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29e01d640 1 -- 172.21.15.83:0/811592322 reap_dead start 2024-09-19T09:01:51.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 shutdown_connections 2024-09-19T09:01:51.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 >> 172.21.15.83:0/811592322 conn(0x7fc2980fc7a0 msgr2=0x7fc2980fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 shutdown_connections 2024-09-19T09:01:51.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.049+0000 7fc29fa80640 1 -- 172.21.15.83:0/811592322 wait complete. 2024-09-19T09:01:51.731 INFO:teuthology.orchestra.run.smithi083.stdout:68719476811 2024-09-19T09:01:51.731 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 -- 172.21.15.83:0/2271479172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 msgr2=0x7f9378100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2271479172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378100560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f936c009ca0 tx=0x7f936c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 -- 172.21.15.83:0/2271479172 shutdown_connections 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2271479172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9378100aa0 0x7f937810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2271479172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378100560 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2271479172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9378106b80 0x7f9378106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 -- 172.21.15.83:0/2271479172 >> 172.21.15.83:0/2271479172 conn(0x7f9378077230 msgr2=0x7f93780fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 -- 172.21.15.83:0/2271479172 shutdown_connections 2024-09-19T09:01:51.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.920+0000 7f937d5ef640 1 -- 172.21.15.83:0/2271479172 wait complete. 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f937d5ef640 1 Processor -- start 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f937d5ef640 1 -- start start 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f937d5ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f937d5ef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9378100aa0 0x7f9378198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f937d5ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9378106b80 0x7f937819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f937d5ef640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9378111f90 con 0x7f9378100100 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f9376ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.921+0000 7f9376ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37008/0 (socket says 172.21.15.83:37008) 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 -- 172.21.15.83:0/2377600813 learned_addr learned my addr 172.21.15.83:0/2377600813 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9378111e10 con 0x7f9378106b80 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9378112110 con 0x7f9378100aa0 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f93767fc640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9378100aa0 0x7f9378198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 -- 172.21.15.83:0/2377600813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9378100aa0 msgr2=0x7f9378198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9378100aa0 0x7f9378198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 -- 172.21.15.83:0/2377600813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9378106b80 msgr2=0x7f937819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f93777fe640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9378106b80 0x7f937819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9378106b80 0x7f937819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937819d520 con 0x7f9378100100 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f93777fe640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9378106b80 0x7f937819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f9376ffd640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378198570 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f937000d950 tx=0x7f937000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370017070 con 0x7f9378100100 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937819d810 con 0x7f9378100100 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9370009c30 con 0x7f9378100100 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937000f620 con 0x7f9378100100 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.922+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93781a50f0 con 0x7f9378100100 2024-09-19T09:01:51.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.923+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9378062900 con 0x7f9378100100 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.924+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f93700109a0 con 0x7f9378100100 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f935ffff640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f93600a32d0 0x7f93600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f93700cfee0 con 0x7f9378100100 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f93767fc640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f93600a32d0 0x7f93600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f935ffff640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] conn(0x7f93600ae4a0 0x7f93600b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93600b1010 con 0x7f93600ae4a0 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f93700d0290 con 0x7f9378100100 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.925+0000 7f93777fe640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] conn(0x7f93600ae4a0 0x7f93600b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.926+0000 7f93767fc640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f93600a32d0 0x7f93600a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f936c000f80 tx=0x7f936c031b20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.926+0000 7f93777fe640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] conn(0x7f93600ae4a0 0x7f93600b0940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.926+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== osd.3 v2:172.21.15.83:6810/261647633 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93600b1010 con 0x7f93600ae4a0 2024-09-19T09:01:51.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 --> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9378062d00 con 0x7f93600ae4a0 2024-09-19T09:01:51.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f935ffff640 1 -- 172.21.15.83:0/2377600813 <== osd.3 v2:172.21.15.83:6810/261647633 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9378062d00 con 0x7f93600ae4a0 2024-09-19T09:01:51.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] conn(0x7f93600ae4a0 msgr2=0x7f93600b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] conn(0x7f93600ae4a0 0x7f93600b0940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f93600a32d0 msgr2=0x7f93600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f93600a32d0 0x7f93600a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f936c000f80 tx=0x7f936c031b20 comp rx=0 tx=0).stop 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 msgr2=0x7f9378198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f937d5ef640 1 --2- 172.21.15.83:0/2377600813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9378100100 0x7f9378198570 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f937000d950 tx=0x7f937000de10 comp rx=0 tx=0).stop 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.940+0000 7f93777fe640 1 -- 172.21.15.83:0/2377600813 reap_dead start 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.941+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 shutdown_connections 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.941+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 >> 172.21.15.83:0/2377600813 conn(0x7f9378077230 msgr2=0x7f9378104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.941+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 shutdown_connections 2024-09-19T09:01:51.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:51.941+0000 7f937d5ef640 1 -- 172.21.15.83:0/2377600813 wait complete. 2024-09-19T09:01:52.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:51 smithi083 ceph-mon[30926]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-19T09:01:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 -- 172.21.15.83:0/1691416355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908101de0 msgr2=0x7fd9081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 --2- 172.21.15.83:0/1691416355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908101de0 0x7fd9081021c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009900 tx=0x7fd8f802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 -- 172.21.15.83:0/1691416355 shutdown_connections 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 --2- 172.21.15.83:0/1691416355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd908106f10 0x7fd90810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 --2- 172.21.15.83:0/1691416355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd908102790 0x7fd9081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 --2- 172.21.15.83:0/1691416355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908101de0 0x7fd9081021c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 -- 172.21.15.83:0/1691416355 >> 172.21.15.83:0/1691416355 conn(0x7fd9080fd8c0 msgr2=0x7fd9080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 -- 172.21.15.83:0/1691416355 shutdown_connections 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.909+0000 7fd90d014640 1 -- 172.21.15.83:0/1691416355 wait complete. 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 Processor -- start 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 -- start start 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd908101de0 0x7fd908198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd908102790 0x7fd9081988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908106f10 0x7fd90819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd908111e40 con 0x7fd908106f10 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd908111cc0 con 0x7fd908102790 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90d014640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd908111fc0 con 0x7fd908101de0 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908106f10 0x7fd90819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908106f10 0x7fd90819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36976/0 (socket says 172.21.15.83:36976) 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 -- 172.21.15.83:0/2807296267 learned_addr learned my addr 172.21.15.83:0/2807296267 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd906d9d640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd908101de0 0x7fd908198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90659c640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd908102790 0x7fd9081988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 -- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd908101de0 msgr2=0x7fd908198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd908101de0 0x7fd908198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 -- 172.21.15.83:0/2807296267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd908102790 msgr2=0x7fd9081988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.910+0000 7fd90759e640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd908102790 0x7fd9081988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd90759e640 1 -- 172.21.15.83:0/2807296267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90819d310 con 0x7fd908106f10 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd90659c640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd908102790 0x7fd9081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd90759e640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908106f10 0x7fd90819cc30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b970 tx=0x7fd90000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900019070 con 0x7fd908106f10 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90819d600 con 0x7fd908106f10 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd900014440 con 0x7fd908106f10 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000075d0 con 0x7fd908106f10 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.911+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd908074420 con 0x7fd908106f10 2024-09-19T09:01:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.912+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd908062980 con 0x7fd908106f10 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.913+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd90001c070 con 0x7fd908106f10 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd8effff640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd8f00a32d0 0x7fd8f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd906d9d640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd8f00a32d0 0x7fd8f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd9000cfb30 con 0x7fd908106f10 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd8effff640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] conn(0x7fd8f00ae4a0 0x7fd8f00b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 --> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9000047d0 con 0x7fd8f00ae4a0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fd9000cff80 con 0x7fd908106f10 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd906d9d640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd8f00a32d0 0x7fd8f00a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8031440 tx=0x7fd8f80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.914+0000 7fd90659c640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] conn(0x7fd8f00ae4a0 0x7fd8f00b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.915+0000 7fd90659c640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] conn(0x7fd8f00ae4a0 0x7fd8f00b0940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.916+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== osd.11 v2:172.21.15.184:6824/1459778997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9000047d0 con 0x7fd8f00ae4a0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.929+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 --> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd908062d80 con 0x7fd8f00ae4a0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.929+0000 7fd8effff640 1 -- 172.21.15.83:0/2807296267 <== osd.11 v2:172.21.15.184:6824/1459778997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd908062d80 con 0x7fd8f00ae4a0 2024-09-19T09:01:52.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] conn(0x7fd8f00ae4a0 msgr2=0x7fd8f00b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] conn(0x7fd8f00ae4a0 0x7fd8f00b0940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd8f00a32d0 msgr2=0x7fd8f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd8f00a32d0 0x7fd8f00a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8031440 tx=0x7fd8f80095f0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908106f10 msgr2=0x7fd90819cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 --2- 172.21.15.83:0/2807296267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd908106f10 0x7fd90819cc30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b970 tx=0x7fd90000be30 comp rx=0 tx=0).stop 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90759e640 1 -- 172.21.15.83:0/2807296267 reap_dead start 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 shutdown_connections 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 >> 172.21.15.83:0/2807296267 conn(0x7fd9080fd8c0 msgr2=0x7fd9080fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 shutdown_connections 2024-09-19T09:01:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:50.930+0000 7fd90d014640 1 -- 172.21.15.83:0/2807296267 wait complete. 2024-09-19T09:01:52.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:51 smithi184 ceph-mon[35007]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-19T09:01:52.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:51 smithi122 ceph-mon[34247]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1721433635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c100a80 msgr2=0x7f1c3c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1721433635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c100a80 0x7f1c3c100ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009930 tx=0x7f1c2c02a420 comp rx=0 tx=0).stop 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1721433635 shutdown_connections 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1721433635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c3c101420 0x7f1c3c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1721433635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c100a80 0x7f1c3c100ee0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1721433635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c106a80 0x7f1c3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1721433635 >> 172.21.15.83:0/1721433635 conn(0x7f1c3c0fc7a0 msgr2=0x7f1c3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:52.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1721433635 shutdown_connections 2024-09-19T09:01:52.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.679+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1721433635 wait complete. 2024-09-19T09:01:52.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 Processor -- start 2024-09-19T09:01:52.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 -- start start 2024-09-19T09:01:52.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c100a80 0x7f1c3c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c3c101420 0x7f1c3c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c106a80 0x7f1c3c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c110d30 con 0x7f1c3c106a80 2024-09-19T09:01:52.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c110bb0 con 0x7f1c3c100a80 2024-09-19T09:01:52.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c42b0b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c110eb0 con 0x7f1c3c101420 2024-09-19T09:01:52.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c410a8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c106a80 0x7f1c3c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c410a8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c106a80 0x7f1c3c1030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37024/0 (socket says 172.21.15.83:37024) 2024-09-19T09:01:52.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c410a8640 1 -- 172.21.15.83:0/1408613782 learned_addr learned my addr 172.21.15.83:0/1408613782 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:52.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c33fff640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c3c101420 0x7f1c3c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c410a8640 1 -- 172.21.15.83:0/1408613782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c3c101420 msgr2=0x7f1c3c102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c410a8640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c3c101420 0x7f1c3c102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.680+0000 7f1c410a8640 1 -- 172.21.15.83:0/1408613782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c100a80 msgr2=0x7f1c3c102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c410a8640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c100a80 0x7f1c3c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c410a8640 1 -- 172.21.15.83:0/1408613782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c1a6800 con 0x7f1c3c106a80 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c33fff640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c3c101420 0x7f1c3c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c410a8640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c106a80 0x7f1c3c1030d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400cce0 tx=0x7f1c3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400f450 con 0x7f1c3c106a80 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3c1a6af0 con 0x7f1c3c106a80 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c3400faa0 con 0x7f1c3c106a80 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34018b70 con 0x7f1c3c106a80 2024-09-19T09:01:52.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.681+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3c1a6fe0 con 0x7f1c3c106a80 2024-09-19T09:01:52.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.682+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c3c06aa60 con 0x7f1c3c106a80 2024-09-19T09:01:52.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.683+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1c34018d10 con 0x7f1c3c106a80 2024-09-19T09:01:52.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c31ffb640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1c240a32d0 0x7f1c240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c408a7640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1c240a32d0 0x7f1c240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1c340d05b0 con 0x7f1c3c106a80 2024-09-19T09:01:52.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c31ffb640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] conn(0x7f1c240ae4a0 0x7f1c240b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:52.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 --> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c3401ee50 con 0x7f1c240ae4a0 2024-09-19T09:01:52.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f1c340d0a00 con 0x7f1c3c106a80 2024-09-19T09:01:52.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c33fff640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] conn(0x7f1c240ae4a0 0x7f1c240b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:52.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c408a7640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1c240a32d0 0x7f1c240a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005d80 tx=0x7f1c38005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:52.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.684+0000 7f1c33fff640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] conn(0x7f1c240ae4a0 0x7f1c240b0940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:52.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.685+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== osd.9 v2:172.21.15.83:6826/3960303414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c3401ee50 con 0x7f1c240ae4a0 2024-09-19T09:01:52.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.699+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 --> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c3c1021c0 con 0x7f1c240ae4a0 2024-09-19T09:01:52.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c31ffb640 1 -- 172.21.15.83:0/1408613782 <== osd.9 v2:172.21.15.83:6826/3960303414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1c3c1021c0 con 0x7f1c240ae4a0 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] conn(0x7f1c240ae4a0 msgr2=0x7f1c240b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] conn(0x7f1c240ae4a0 0x7f1c240b0940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1c240a32d0 msgr2=0x7f1c240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1c240a32d0 0x7f1c240a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005d80 tx=0x7f1c38005c90 comp rx=0 tx=0).stop 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c106a80 msgr2=0x7f1c3c1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 --2- 172.21.15.83:0/1408613782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c3c106a80 0x7f1c3c1030d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400cce0 tx=0x7f1c3400a620 comp rx=0 tx=0).stop 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c410a8640 1 -- 172.21.15.83:0/1408613782 reap_dead start 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 shutdown_connections 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 >> 172.21.15.83:0/1408613782 conn(0x7f1c3c0fc7a0 msgr2=0x7f1c3c1048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.700+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 shutdown_connections 2024-09-19T09:01:52.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:52.701+0000 7f1c42b0b640 1 -- 172.21.15.83:0/1408613782 wait complete. 2024-09-19T09:01:53.281 INFO:teuthology.orchestra.run.smithi083.stdout:322122547228 2024-09-19T09:01:53.282 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:01:53.284 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:53.734 INFO:teuthology.orchestra.run.smithi083.stdout:236223201323 2024-09-19T09:01:53.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:01:54.163 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:53 smithi083 ceph-mon[30926]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-19T09:01:54.188 INFO:teuthology.orchestra.run.smithi083.stdout:98784247876 2024-09-19T09:01:54.189 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:01:54.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:53 smithi122 ceph-mon[34247]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-19T09:01:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:53 smithi184 ceph-mon[35007]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-19T09:01:54.480 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:54.484 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:54.484 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:54.910 INFO:teuthology.orchestra.run.smithi083.stdout:270582939686 2024-09-19T09:01:54.910 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:01:54.914 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:54.915 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 -- 172.21.15.83:0/4041975304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4106a80 msgr2=0x7f5aa4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/4041975304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4106a80 0x7f5aa4106e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009930 tx=0x7f5a9402a420 comp rx=0 tx=0).stop 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 -- 172.21.15.83:0/4041975304 shutdown_connections 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/4041975304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4101420 0x7f5aa410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/4041975304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa4100a80 0x7f5aa4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/4041975304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4106a80 0x7f5aa4106e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 -- 172.21.15.83:0/4041975304 >> 172.21.15.83:0/4041975304 conn(0x7f5aa40fc7a0 msgr2=0x7f5aa40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:55.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 -- 172.21.15.83:0/4041975304 shutdown_connections 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.623+0000 7f5aa8f18640 1 -- 172.21.15.83:0/4041975304 wait complete. 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.624+0000 7f5aa8f18640 1 Processor -- start 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.624+0000 7f5aa8f18640 1 -- start start 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.624+0000 7f5aa8f18640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa4100a80 0x7f5aa4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.624+0000 7f5aa8f18640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 0x7f5aa4198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa8f18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4106a80 0x7f5aa419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa8f18640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa4110dd0 con 0x7f5aa4101420 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa8f18640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa4110c50 con 0x7f5aa4106a80 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa8f18640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa4110f50 con 0x7f5aa4100a80 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 0x7f5aa4198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 0x7f5aa4198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37030/0 (socket says 172.21.15.83:37030) 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 -- 172.21.15.83:0/3326897875 learned_addr learned my addr 172.21.15.83:0/3326897875 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa2d9d640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4106a80 0x7f5aa419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa259c640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa4100a80 0x7f5aa4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 -- 172.21.15.83:0/3326897875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa4100a80 msgr2=0x7f5aa4198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa4100a80 0x7f5aa4198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 -- 172.21.15.83:0/3326897875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4106a80 msgr2=0x7f5aa419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4106a80 0x7f5aa419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 -- 172.21.15.83:0/3326897875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa419d4f0 con 0x7f5aa4101420 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa2d9d640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4106a80 0x7f5aa419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:55.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a99d9b640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 0x7f5aa4198a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00b4a0 tx=0x7f5a8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c014070 con 0x7f5aa4101420 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa419d7e0 con 0x7f5aa4101420 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a8c010ac0 con 0x7f5aa4101420 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c017c30 con 0x7f5aa4101420 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.625+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa41a50c0 con 0x7f5aa4101420 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.626+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa4100f60 con 0x7f5aa4101420 2024-09-19T09:01:55.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.628+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5a8c017070 con 0x7f5aa4101420 2024-09-19T09:01:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.628+0000 7f5a9bfff640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5a900a32d0 0x7f5a900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.628+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5a8c0cf0e0 con 0x7f5aa4101420 2024-09-19T09:01:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.628+0000 7f5aa259c640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5a900a32d0 0x7f5a900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.629+0000 7f5aa259c640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5a900a32d0 0x7f5a900a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a94006010 tx=0x7f5a94000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:55.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.633+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a8c09ba50 con 0x7f5aa4101420 2024-09-19T09:01:55.686 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.811+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5aa402d7c0 con 0x7f5aa4101420 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.812+0000 7f5a9bfff640 1 -- 172.21.15.83:0/3326897875 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5a8c09b350 con 0x7f5aa4101420 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi083.stdout:154618822715 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5a900a32d0 msgr2=0x7f5a900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5a900a32d0 0x7f5a900a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a94006010 tx=0x7f5a94000bc0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 msgr2=0x7f5aa4198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 0x7f5aa4198a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00b4a0 tx=0x7f5a8c00b960 comp rx=0 tx=0).stop 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 shutdown_connections 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5a900a32d0 0x7f5a900a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aa4106a80 0x7f5aa419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5aa4101420 0x7f5aa4198a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 --2- 172.21.15.83:0/3326897875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa4100a80 0x7f5aa4198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 >> 172.21.15.83:0/3326897875 conn(0x7f5aa40fc7a0 msgr2=0x7f5aa406ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 shutdown_connections 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.814+0000 7f5aa8f18640 1 -- 172.21.15.83:0/3326897875 wait complete. 2024-09-19T09:01:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 -- 172.21.15.83:0/3108013707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf01036c0 msgr2=0x7f7bf010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/3108013707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf01036c0 0x7f7bf010bbb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009900 tx=0x7f7bdc02a480 comp rx=0 tx=0).stop 2024-09-19T09:01:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 -- 172.21.15.83:0/3108013707 shutdown_connections 2024-09-19T09:01:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/3108013707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bf010c180 0x7f7bf010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/3108013707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf01036c0 0x7f7bf010bbb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/3108013707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf0102da0 0x7f7bf0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 -- 172.21.15.83:0/3108013707 >> 172.21.15.83:0/3108013707 conn(0x7f7bf00fc7a0 msgr2=0x7f7bf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 -- 172.21.15.83:0/3108013707 shutdown_connections 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 -- 172.21.15.83:0/3108013707 wait complete. 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 Processor -- start 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.879+0000 7f7bf6c36640 1 -- start start 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf0102da0 0x7f7bf0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bf01036c0 0x7f7bf0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 0x7f7bf019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0111e50 con 0x7f7bf010c180 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0111cd0 con 0x7f7bf01036c0 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0111fd0 con 0x7f7bf0102da0 2024-09-19T09:01:55.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 0x7f7bf019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 0x7f7bf019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37052/0 (socket says 172.21.15.83:37052) 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 -- 172.21.15.83:0/424125086 learned_addr learned my addr 172.21.15.83:0/424125086 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7beffff640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bf01036c0 0x7f7bf0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf49d2640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf0102da0 0x7f7bf0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 -- 172.21.15.83:0/424125086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf0102da0 msgr2=0x7f7bf0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf0102da0 0x7f7bf0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 -- 172.21.15.83:0/424125086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bf01036c0 msgr2=0x7f7bf0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bf01036c0 0x7f7bf0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 -- 172.21.15.83:0/424125086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf019d3c0 con 0x7f7bf010c180 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf51d3640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 0x7f7bf019cce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7be800cad0 tx=0x7f7be800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be800ae20 con 0x7f7bf010c180 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7be8005020 con 0x7f7bf010c180 2024-09-19T09:01:55.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf019d6b0 con 0x7f7bf010c180 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.880+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be800f6b0 con 0x7f7bf010c180 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.881+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf01a4f90 con 0x7f7bf010c180 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.882+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf0103180 con 0x7f7bf010c180 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.882+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7be80051d0 con 0x7f7bf010c180 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.883+0000 7f7bedffb640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7be00a3350 0x7f7be00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.883+0000 7f7bf49d2640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7be00a3350 0x7f7be00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.883+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7be80cfe00 con 0x7f7bf010c180 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.884+0000 7f7bf49d2640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7be00a3350 0x7f7be00a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009890 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:55.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:55.888+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7be8014030 con 0x7f7bf010c180 2024-09-19T09:01:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.060+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7bf01071f0 con 0x7f7bf010c180 2024-09-19T09:01:56.060 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:55 smithi083 ceph-mon[30926]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:01:56.060 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:55 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3326897875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:01:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.060+0000 7f7bedffb640 1 -- 172.21.15.83:0/424125086 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7be809c660 con 0x7f7bf010c180 2024-09-19T09:01:56.061 INFO:teuthology.orchestra.run.smithi083.stdout:34359738453 2024-09-19T09:01:56.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7be00a3350 msgr2=0x7f7be00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:56.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7be00a3350 0x7f7be00a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009890 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2024-09-19T09:01:56.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 msgr2=0x7f7bf019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 0x7f7bf019cce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7be800cad0 tx=0x7f7be800cf90 comp rx=0 tx=0).stop 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 shutdown_connections 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7be00a3350 0x7f7be00a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7bf010c180 0x7f7bf019cce0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bf01036c0 0x7f7bf0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 --2- 172.21.15.83:0/424125086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf0102da0 0x7f7bf0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 >> 172.21.15.83:0/424125086 conn(0x7f7bf00fc7a0 msgr2=0x7f7bf00fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 shutdown_connections 2024-09-19T09:01:56.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:56.062+0000 7f7bf6c36640 1 -- 172.21.15.83:0/424125086 wait complete. 2024-09-19T09:01:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:55 smithi184 ceph-mon[35007]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:01:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:55 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3326897875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:01:56.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:55 smithi122 ceph-mon[34247]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:01:56.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:55 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3326897875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:01:56.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738453 for osd.0 2024-09-19T09:01:56.799 DEBUG:teuthology.parallel:result is None 2024-09-19T09:01:57.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:56 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/424125086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:01:57.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:56 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/424125086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:01:57.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:56 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/424125086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 -- 172.21.15.83:0/60980726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c101de0 msgr2=0x7f0f5c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 --2- 172.21.15.83:0/60980726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c101de0 0x7f0f5c1021c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009900 tx=0x7f0f5802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 -- 172.21.15.83:0/60980726 shutdown_connections 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 --2- 172.21.15.83:0/60980726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c106f10 0x7f0f5c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 --2- 172.21.15.83:0/60980726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f5c102790 0x7f0f5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 --2- 172.21.15.83:0/60980726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c101de0 0x7f0f5c1021c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 -- 172.21.15.83:0/60980726 >> 172.21.15.83:0/60980726 conn(0x7f0f5c0fd8c0 msgr2=0x7f0f5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.638+0000 7f0f635f7640 1 -- 172.21.15.83:0/60980726 shutdown_connections 2024-09-19T09:01:57.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 -- 172.21.15.83:0/60980726 wait complete. 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 Processor -- start 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 -- start start 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f5c101de0 0x7f0f5c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c102790 0x7f0f5c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 0x7f0f5c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c111e20 con 0x7f0f5c106f10 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c111ca0 con 0x7f0f5c102790 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f635f7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c111fa0 con 0x7f0f5c101de0 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.639+0000 7f0f61b94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 0x7f0f5c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 0x7f0f5c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37074/0 (socket says 172.21.15.83:37074) 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 -- 172.21.15.83:0/2875245316 learned_addr learned my addr 172.21.15.83:0/2875245316 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:57.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61393640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f5c101de0 0x7f0f5c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f60b92640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c102790 0x7f0f5c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 -- 172.21.15.83:0/2875245316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f5c101de0 msgr2=0x7f0f5c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f5c101de0 0x7f0f5c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 -- 172.21.15.83:0/2875245316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c102790 msgr2=0x7f0f5c198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c102790 0x7f0f5c198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 -- 172.21.15.83:0/2875245316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c19d2c0 con 0x7f0f5c106f10 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f61b94640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 0x7f0f5c19cbe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400cce0 tx=0x7f0f5400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400f450 con 0x7f0f5c106f10 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c19d5b0 con 0x7f0f5c106f10 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f5400faa0 con 0x7f0f5c106f10 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54018b70 con 0x7f0f5c106f10 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.640+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1a4e90 con 0x7f0f5c106f10 2024-09-19T09:01:57.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.641+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c1021c0 con 0x7f0f5c106f10 2024-09-19T09:01:57.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.643+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0f54018d10 con 0x7f0f5c106f10 2024-09-19T09:01:57.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.643+0000 7f0f527fc640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0f480a32d0 0x7f0f480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.644+0000 7f0f61393640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0f480a32d0 0x7f0f480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.644+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f0f540d01e0 con 0x7f0f5c106f10 2024-09-19T09:01:57.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.644+0000 7f0f61393640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0f480a32d0 0x7f0f480a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f58031440 tx=0x7f0f58005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:57.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.647+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f54014030 con 0x7f0f5c106f10 2024-09-19T09:01:57.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.819+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0f5c109b60 con 0x7f0f5c106f10 2024-09-19T09:01:57.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.820+0000 7f0f527fc640 1 -- 172.21.15.83:0/2875245316 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0f5409cad0 con 0x7f0f5c106f10 2024-09-19T09:01:57.820 INFO:teuthology.orchestra.run.smithi083.stdout:322122547230 2024-09-19T09:01:57.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0f480a32d0 msgr2=0x7f0f480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0f480a32d0 0x7f0f480a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f58031440 tx=0x7f0f58005e80 comp rx=0 tx=0).stop 2024-09-19T09:01:57.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 msgr2=0x7f0f5c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 0x7f0f5c19cbe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400cce0 tx=0x7f0f5400a620 comp rx=0 tx=0).stop 2024-09-19T09:01:57.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 shutdown_connections 2024-09-19T09:01:57.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0f480a32d0 0x7f0f480a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f5c106f10 0x7f0f5c19cbe0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c102790 0x7f0f5c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 --2- 172.21.15.83:0/2875245316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f5c101de0 0x7f0f5c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 >> 172.21.15.83:0/2875245316 conn(0x7f0f5c0fd8c0 msgr2=0x7f0f5c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:57.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 shutdown_connections 2024-09-19T09:01:57.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.822+0000 7f0f635f7640 1 -- 172.21.15.83:0/2875245316 wait complete. 2024-09-19T09:01:57.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 -- 172.21.15.83:0/553071560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 msgr2=0x7f841c104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 --2- 172.21.15.83:0/553071560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c104e30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f841000aa10 tx=0x7f841002b720 comp rx=0 tx=0).stop 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 -- 172.21.15.83:0/553071560 shutdown_connections 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 --2- 172.21.15.83:0/553071560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c105560 0x7f841c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 --2- 172.21.15.83:0/553071560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c104e30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 --2- 172.21.15.83:0/553071560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c100430 0x7f841c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 -- 172.21.15.83:0/553071560 >> 172.21.15.83:0/553071560 conn(0x7f841c077230 msgr2=0x7f841c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 -- 172.21.15.83:0/553071560 shutdown_connections 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.864+0000 7f8422043640 1 -- 172.21.15.83:0/553071560 wait complete. 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 Processor -- start 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 -- start start 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100430 0x7f841c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c105560 0x7f841c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f841c111e00 con 0x7f841c100de0 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f841c111c80 con 0x7f841c105560 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f8422043640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f841c111f80 con 0x7f841c100430 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37092/0 (socket says 172.21.15.83:37092) 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 -- 172.21.15.83:0/1673961377 learned_addr learned my addr 172.21.15.83:0/1673961377 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841b7fe640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100430 0x7f841c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841bfff640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c105560 0x7f841c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 -- 172.21.15.83:0/1673961377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100430 msgr2=0x7f841c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100430 0x7f841c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 -- 172.21.15.83:0/1673961377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c105560 msgr2=0x7f841c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c105560 0x7f841c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841affd640 1 -- 172.21.15.83:0/1673961377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c19d300 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841b7fe640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100430 0x7f841c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.865+0000 7f841bfff640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c105560 0x7f841c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.866+0000 7f841affd640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c198890 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8410005940 tx=0x7f84100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.866+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841003f070 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.866+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8410032400 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.866+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c19d590 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.866+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410036040 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.866+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c1a4ed0 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.867+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c101910 con 0x7f841c100de0 2024-09-19T09:01:57.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.868+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8410042070 con 0x7f841c100de0 2024-09-19T09:01:57.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.869+0000 7f8418ff9640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a32d0 0x7f84040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.869+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f84100f0560 con 0x7f841c100de0 2024-09-19T09:01:57.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.869+0000 7f841b7fe640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a32d0 0x7f84040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.870+0000 7f841b7fe640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a32d0 0x7f84040a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f840c009b40 tx=0x7f840c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:57.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:57.873+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84100bcdc0 con 0x7f841c100de0 2024-09-19T09:01:58.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.051+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f841c1087a0 con 0x7f841c100de0 2024-09-19T09:01:58.051 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:57 smithi083 ceph-mon[30926]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:01:58.051 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:57 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2875245316' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:01:58.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.051+0000 7f8418ff9640 1 -- 172.21.15.83:0/1673961377 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f84100bc6c0 con 0x7f841c100de0 2024-09-19T09:01:58.052 INFO:teuthology.orchestra.run.smithi083.stdout:128849018944 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a32d0 msgr2=0x7f84040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a32d0 0x7f84040a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f840c009b40 tx=0x7f840c005e50 comp rx=0 tx=0).stop 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 msgr2=0x7f841c198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c198890 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8410005940 tx=0x7f84100042f0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 shutdown_connections 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f84040a32d0 0x7f84040a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f841c105560 0x7f841c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841c100de0 0x7f841c198890 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 --2- 172.21.15.83:0/1673961377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f841c100430 0x7f841c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 >> 172.21.15.83:0/1673961377 conn(0x7f841c077230 msgr2=0x7f841c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 shutdown_connections 2024-09-19T09:01:58.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:01:58.054+0000 7f8422043640 1 -- 172.21.15.83:0/1673961377 wait complete. 2024-09-19T09:01:58.393 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822713 got 154618822715 for osd.5 2024-09-19T09:01:58.393 DEBUG:teuthology.parallel:result is None 2024-09-19T09:01:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:57 smithi184 ceph-mon[35007]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:01:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:57 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2875245316' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:01:58.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:57 smithi122 ceph-mon[34247]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:01:58.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:57 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2875245316' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:01:59.260 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:01:59 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1673961377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:01:59.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018942 got 128849018944 for osd.4 2024-09-19T09:01:59.289 DEBUG:teuthology.parallel:result is None 2024-09-19T09:01:59.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:01:59 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1673961377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:01:59.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:01:59 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1673961377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:01:59.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547228 got 322122547230 for osd.11 2024-09-19T09:01:59.894 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:00.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 -- 172.21.15.83:0/3515354600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c102790 msgr2=0x7ff53c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 --2- 172.21.15.83:0/3515354600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c102790 0x7ff53c1067e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff530009900 tx=0x7ff53002a410 comp rx=0 tx=0).stop 2024-09-19T09:02:00.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 -- 172.21.15.83:0/3515354600 shutdown_connections 2024-09-19T09:02:00.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 --2- 172.21.15.83:0/3515354600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53c106f10 0x7ff53c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 --2- 172.21.15.83:0/3515354600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c102790 0x7ff53c1067e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 --2- 172.21.15.83:0/3515354600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c101de0 0x7ff53c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.097+0000 7ff5425cb640 1 -- 172.21.15.83:0/3515354600 >> 172.21.15.83:0/3515354600 conn(0x7ff53c0fd8c0 msgr2=0x7ff53c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 -- 172.21.15.83:0/3515354600 shutdown_connections 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 -- 172.21.15.83:0/3515354600 wait complete. 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 Processor -- start 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 -- start start 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 0x7ff53c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53c102790 0x7ff53c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c106f10 0x7ff53c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c111de0 con 0x7ff53c101de0 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.098+0000 7ff5425cb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c111c60 con 0x7ff53c102790 2024-09-19T09:02:00.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff5425cb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c111f60 con 0x7ff53c106f10 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 0x7ff53c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 0x7ff53c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58632/0 (socket says 172.21.15.83:58632) 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 -- 172.21.15.83:0/1779646167 learned_addr learned my addr 172.21.15.83:0/1779646167 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff540b68640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c106f10 0x7ff53c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53b7fe640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53c102790 0x7ff53c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 -- 172.21.15.83:0/1779646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c106f10 msgr2=0x7ff53c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c106f10 0x7ff53c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 -- 172.21.15.83:0/1779646167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53c102790 msgr2=0x7ff53c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53c102790 0x7ff53c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 -- 172.21.15.83:0/1779646167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c19d290 con 0x7ff53c101de0 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff53bfff640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 0x7ff53c1982e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c920 tx=0x7ff52c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c007c70 con 0x7ff53c101de0 2024-09-19T09:02:00.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff52c007e10 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c19d580 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c018820 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.099+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c1a4e60 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.100+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c1021c0 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.101+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff52c0189c0 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.102+0000 7ff5397fa640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff5240a32d0 0x7ff5240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.102+0000 7ff53b7fe640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff5240a32d0 0x7ff5240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.102+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff52c0cff30 con 0x7ff53c101de0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.102+0000 7ff53b7fe640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff5240a32d0 0x7ff5240a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff530031440 tx=0x7ff5300095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:00.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.106+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff52c014030 con 0x7ff53c101de0 2024-09-19T09:02:00.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:00 smithi083 ceph-mon[30926]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.280+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff53c109b60 con 0x7ff53c101de0 2024-09-19T09:02:00.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.281+0000 7ff5397fa640 1 -- 172.21.15.83:0/1779646167 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff52c09c790 con 0x7ff53c101de0 2024-09-19T09:02:00.281 INFO:teuthology.orchestra.run.smithi083.stdout:51539607633 2024-09-19T09:02:00.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff5240a32d0 msgr2=0x7ff5240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff5240a32d0 0x7ff5240a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff530031440 tx=0x7ff5300095f0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 msgr2=0x7ff53c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 0x7ff53c1982e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c920 tx=0x7ff52c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 shutdown_connections 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff5240a32d0 0x7ff5240a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c106f10 0x7ff53c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff53c102790 0x7ff53c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 --2- 172.21.15.83:0/1779646167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff53c101de0 0x7ff53c1982e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 >> 172.21.15.83:0/1779646167 conn(0x7ff53c0fd8c0 msgr2=0x7ff53c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 shutdown_connections 2024-09-19T09:02:00.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.283+0000 7ff5425cb640 1 -- 172.21.15.83:0/1779646167 wait complete. 2024-09-19T09:02:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:00 smithi184 ceph-mon[35007]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:00.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:00 smithi122 ceph-mon[34247]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:00.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 -- 172.21.15.83:0/1254163813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4106a80 msgr2=0x7f7fa4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 --2- 172.21.15.83:0/1254163813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4106a80 0x7f7fa4106e60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009930 tx=0x7f7f9402a420 comp rx=0 tx=0).stop 2024-09-19T09:02:00.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 -- 172.21.15.83:0/1254163813 shutdown_connections 2024-09-19T09:02:00.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 --2- 172.21.15.83:0/1254163813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 0x7f7fa410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 --2- 172.21.15.83:0/1254163813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa4100a80 0x7f7fa4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 --2- 172.21.15.83:0/1254163813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4106a80 0x7f7fa4106e60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 -- 172.21.15.83:0/1254163813 >> 172.21.15.83:0/1254163813 conn(0x7f7fa40fc7a0 msgr2=0x7f7fa40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 -- 172.21.15.83:0/1254163813 shutdown_connections 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.783+0000 7f7fa9616640 1 -- 172.21.15.83:0/1254163813 wait complete. 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 Processor -- start 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 -- start start 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 0x7f7fa4197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 0x7f7fa41977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa4106a80 0x7f7fa419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4110d50 con 0x7f7fa4100a80 2024-09-19T09:02:00.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4110bd0 con 0x7f7fa4106a80 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa9616640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4110ed0 con 0x7f7fa4101420 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 0x7f7fa4197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 0x7f7fa4197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58646/0 (socket says 172.21.15.83:58646) 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 -- 172.21.15.83:0/397180839 learned_addr learned my addr 172.21.15.83:0/397180839 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7f9a7fc640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 0x7f7fa41977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa37fe640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa4106a80 0x7f7fa419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 -- 172.21.15.83:0/397180839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 msgr2=0x7f7fa41977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 0x7f7fa41977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 -- 172.21.15.83:0/397180839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa4106a80 msgr2=0x7f7fa419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa4106a80 0x7f7fa419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7fa2ffd640 1 -- 172.21.15.83:0/397180839 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa419c220 con 0x7f7fa4100a80 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.784+0000 7f7f9a7fc640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 0x7f7fa41977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.785+0000 7f7fa2ffd640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 0x7f7fa4197270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f94005940 tx=0x7f7f940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:00.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.785+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9403f030 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.785+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa419c4b0 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.785+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f94003cb0 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.785+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f94035070 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.785+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa41a3df0 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.786+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa4100ee0 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.787+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7f94042030 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.788+0000 7f7fa0ff9640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f900a32d0 0x7f7f900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.788+0000 7f7f9a7fc640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f900a32d0 0x7f7f900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.788+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7f940f06b0 con 0x7f7fa4100a80 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.788+0000 7f7f9a7fc640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f900a32d0 0x7f7f900a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40fede0 tx=0x7f7f8c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:00.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.791+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f940bcf10 con 0x7f7fa4100a80 2024-09-19T09:02:00.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.963+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f7fa4108ff0 con 0x7f7fa4100a80 2024-09-19T09:02:00.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.964+0000 7f7fa0ff9640 1 -- 172.21.15.83:0/397180839 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7f940bc810 con 0x7f7fa4100a80 2024-09-19T09:02:00.965 INFO:teuthology.orchestra.run.smithi083.stdout:292057776163 2024-09-19T09:02:00.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f900a32d0 msgr2=0x7f7f900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f900a32d0 0x7f7f900a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40fede0 tx=0x7f7f8c00a5c0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 msgr2=0x7f7fa4197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 0x7f7fa4197270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f94005940 tx=0x7f7f940042f0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 shutdown_connections 2024-09-19T09:02:00.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7f900a32d0 0x7f7f900a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fa4106a80 0x7f7fa419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fa4101420 0x7f7fa41977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 --2- 172.21.15.83:0/397180839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fa4100a80 0x7f7fa4197270 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 >> 172.21.15.83:0/397180839 conn(0x7f7fa40fc7a0 msgr2=0x7f7fa40fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:00.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 shutdown_connections 2024-09-19T09:02:00.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:00.966+0000 7f7fa9616640 1 -- 172.21.15.83:0/397180839 wait complete. 2024-09-19T09:02:01.269 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:01 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1779646167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:02:01.269 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:01 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/397180839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:02:01.296 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607630 got 51539607633 for osd.1 2024-09-19T09:02:01.296 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:01.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:01 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1779646167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:02:01.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:01 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/397180839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:02:01.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:01 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1779646167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:02:01.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:01 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/397180839' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:02:01.986 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776161 got 292057776163 for osd.10 2024-09-19T09:02:01.987 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:02.060 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:02.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:02 smithi083 ceph-mon[30926]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 -- 172.21.15.83:0/3707006235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604100a80 msgr2=0x7fe604100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 --2- 172.21.15.83:0/3707006235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604100a80 0x7fe604100ee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009930 tx=0x7fe5ec02a420 comp rx=0 tx=0).stop 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 -- 172.21.15.83:0/3707006235 shutdown_connections 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 --2- 172.21.15.83:0/3707006235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604101420 0x7fe60410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 --2- 172.21.15.83:0/3707006235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604100a80 0x7fe604100ee0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 --2- 172.21.15.83:0/3707006235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 0x7fe604106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 -- 172.21.15.83:0/3707006235 >> 172.21.15.83:0/3707006235 conn(0x7fe6040fc7a0 msgr2=0x7fe6040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 -- 172.21.15.83:0/3707006235 shutdown_connections 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.277+0000 7fe60a769640 1 -- 172.21.15.83:0/3707006235 wait complete. 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 Processor -- start 2024-09-19T09:02:02.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 -- start start 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604100a80 0x7fe604197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 0x7fe6041977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 0x7fe60419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe604110d30 con 0x7fe604101420 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe604110bb0 con 0x7fe604106a80 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe60a769640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe604110eb0 con 0x7fe604100a80 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe5fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 0x7fe6041977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe5fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 0x7fe6041977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58660/0 (socket says 172.21.15.83:58660) 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe5fbfff640 1 -- 172.21.15.83:0/3288505034 learned_addr learned my addr 172.21.15.83:0/3288505034 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe608d06640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 0x7fe60419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.278+0000 7fe603fff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604100a80 0x7fe604197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe5fbfff640 1 -- 172.21.15.83:0/3288505034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604100a80 msgr2=0x7fe604197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe5fbfff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604100a80 0x7fe604197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe5fbfff640 1 -- 172.21.15.83:0/3288505034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 msgr2=0x7fe60419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe5fbfff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 0x7fe60419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe5fbfff640 1 -- 172.21.15.83:0/3288505034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60419c220 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe608d06640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 0x7fe60419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe603fff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604100a80 0x7fe604197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe5fbfff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 0x7fe6041977b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec005940 tx=0x7fe5ec0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec03f030 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5ec0044c0 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60419c4b0 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec035070 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.279+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6041a3df0 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.280+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe604100ee0 con 0x7fe604101420 2024-09-19T09:02:02.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.281+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe5ec042030 con 0x7fe604101420 2024-09-19T09:02:02.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.282+0000 7fe601ffb640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5f00a3350 0x7fe5f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.282+0000 7fe603fff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5f00a3350 0x7fe5f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.282+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe5ec0f0400 con 0x7fe604101420 2024-09-19T09:02:02.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.282+0000 7fe603fff640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5f00a3350 0x7fe5f00a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009ad0 tx=0x7fe5f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.285+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5ec0bcc60 con 0x7fe604101420 2024-09-19T09:02:02.309 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:02.309 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:02 smithi184 ceph-mon[35007]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-19T09:02:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:02 smithi122 ceph-mon[34247]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-19T09:02:02.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.469+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe604108a80 con 0x7fe604101420 2024-09-19T09:02:02.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.469+0000 7fe601ffb640 1 -- 172.21.15.83:0/3288505034 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe5ec0bc560 con 0x7fe604101420 2024-09-19T09:02:02.469 INFO:teuthology.orchestra.run.smithi083.stdout:206158430259 2024-09-19T09:02:02.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5f00a3350 msgr2=0x7fe5f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5f00a3350 0x7fe5f00a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009ad0 tx=0x7fe5f4005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 msgr2=0x7fe6041977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 0x7fe6041977b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec005940 tx=0x7fe5ec0040c0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 shutdown_connections 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5f00a3350 0x7fe5f00a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe604106a80 0x7fe60419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe604101420 0x7fe6041977b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 --2- 172.21.15.83:0/3288505034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe604100a80 0x7fe604197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 >> 172.21.15.83:0/3288505034 conn(0x7fe6040fc7a0 msgr2=0x7fe6040fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 shutdown_connections 2024-09-19T09:02:02.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:02.471+0000 7fe60a769640 1 -- 172.21.15.83:0/3288505034 wait complete. 2024-09-19T09:02:03.257 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430256 got 206158430259 for osd.7 2024-09-19T09:02:03.257 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:03.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:03 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3288505034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:02:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:03 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3288505034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:02:03.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:03 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3288505034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 -- 172.21.15.83:0/166118158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc0fffd0 msgr2=0x7f6acc100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/166118158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc0fffd0 0x7f6acc100430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac002a410 comp rx=0 tx=0).stop 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 -- 172.21.15.83:0/166118158 shutdown_connections 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/166118158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc100970 0x7f6acc10ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/166118158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc0fffd0 0x7f6acc100430 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/166118158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc106bb0 0x7f6acc106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 -- 172.21.15.83:0/166118158 >> 172.21.15.83:0/166118158 conn(0x7f6acc0fbee0 msgr2=0x7f6acc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 -- 172.21.15.83:0/166118158 shutdown_connections 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 -- 172.21.15.83:0/166118158 wait complete. 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.719+0000 7f6ad1b11640 1 Processor -- start 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 -- start start 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc0fffd0 0x7f6acc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 0x7f6acc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc106bb0 0x7f6acc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc111f70 con 0x7f6acc100970 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc111df0 con 0x7f6acc0fffd0 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6ad1b11640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1120f0 con 0x7f6acc106bb0 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 0x7f6acc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:03.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 0x7f6acc19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58682/0 (socket says 172.21.15.83:58682) 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 -- 172.21.15.83:0/3264194112 learned_addr learned my addr 172.21.15.83:0/3264194112 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acb7fe640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc0fffd0 0x7f6acc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acbfff640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc106bb0 0x7f6acc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 -- 172.21.15.83:0/3264194112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc106bb0 msgr2=0x7f6acc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc106bb0 0x7f6acc19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 -- 172.21.15.83:0/3264194112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc0fffd0 msgr2=0x7f6acc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc0fffd0 0x7f6acc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acaffd640 1 -- 172.21.15.83:0/3264194112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc19f5d0 con 0x7f6acc100970 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.720+0000 7f6acb7fe640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc0fffd0 0x7f6acc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.721+0000 7f6acaffd640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 0x7f6acc19ab60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006010 tx=0x7f6ac0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.721+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac003f030 con 0x7f6acc100970 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.721+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ac00035f0 con 0x7f6acc100970 2024-09-19T09:02:03.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.721+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0035070 con 0x7f6acc100970 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.721+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc19f860 con 0x7f6acc100970 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.721+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1a71a0 con 0x7f6acc100970 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.722+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc1032f0 con 0x7f6acc100970 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.723+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ac0003b10 con 0x7f6acc100970 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.724+0000 7f6ac8ff9640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ab40a32d0 0x7f6ab40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.724+0000 7f6acb7fe640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ab40a32d0 0x7f6ab40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.724+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6ac00f0c40 con 0x7f6acc100970 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.724+0000 7f6acb7fe640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ab40a32d0 0x7f6ab40a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00baa0 tx=0x7f6abc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:03.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.727+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ac00bd4a0 con 0x7f6acc100970 2024-09-19T09:02:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:03.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.909+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6acc1a7370 con 0x7f6acc100970 2024-09-19T09:02:03.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.910+0000 7f6ac8ff9640 1 -- 172.21.15.83:0/3264194112 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6ac00bcda0 con 0x7f6acc100970 2024-09-19T09:02:03.910 INFO:teuthology.orchestra.run.smithi083.stdout:184683593784 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ab40a32d0 msgr2=0x7f6ab40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ab40a32d0 0x7f6ab40a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00baa0 tx=0x7f6abc005d90 comp rx=0 tx=0).stop 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 msgr2=0x7f6acc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 0x7f6acc19ab60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006010 tx=0x7f6ac0004270 comp rx=0 tx=0).stop 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 shutdown_connections 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ab40a32d0 0x7f6ab40a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc106bb0 0x7f6acc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6acc100970 0x7f6acc19ab60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 --2- 172.21.15.83:0/3264194112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6acc0fffd0 0x7f6acc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 >> 172.21.15.83:0/3264194112 conn(0x7f6acc0fbee0 msgr2=0x7f6acc0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 shutdown_connections 2024-09-19T09:02:03.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:03.912+0000 7f6ad1b11640 1 -- 172.21.15.83:0/3264194112 wait complete. 2024-09-19T09:02:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:04 smithi083 ceph-mon[30926]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:02:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:04 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3264194112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:02:04.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:04 smithi184 ceph-mon[35007]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:02:04.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:04 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3264194112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:02:04.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:04 smithi122 ceph-mon[34247]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:02:04.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:04 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3264194112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:02:04.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.695+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/1202697887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 msgr2=0x7fbc78101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.695+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/1202697887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc78101850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009900 tx=0x7fbc6802a410 comp rx=0 tx=0).stop 2024-09-19T09:02:04.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/1202697887 shutdown_connections 2024-09-19T09:02:04.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/1202697887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78105de0 0x7fbc7810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/1202697887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc78101e20 0x7fbc781056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/1202697887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc78101850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/1202697887 >> 172.21.15.83:0/1202697887 conn(0x7fbc78077230 msgr2=0x7fbc780fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:04.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/1202697887 shutdown_connections 2024-09-19T09:02:04.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/1202697887 wait complete. 2024-09-19T09:02:04.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 Processor -- start 2024-09-19T09:02:04.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.696+0000 7fbc7c9d9640 1 -- start start 2024-09-19T09:02:04.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc781991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78101e20 0x7fbc78199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc78105de0 0x7fbc781a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78110cb0 con 0x7fbc78101470 2024-09-19T09:02:04.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78110b30 con 0x7fbc78101e20 2024-09-19T09:02:04.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78110e30 con 0x7fbc78105de0 2024-09-19T09:02:04.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc781991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc781991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58714/0 (socket says 172.21.15.83:58714) 2024-09-19T09:02:04.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 -- 172.21.15.83:0/3981150032 learned_addr learned my addr 172.21.15.83:0/3981150032 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:04.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc75d9b640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78101e20 0x7fbc78199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc76d9d640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc78105de0 0x7fbc781a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 -- 172.21.15.83:0/3981150032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc78105de0 msgr2=0x7fbc781a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc78105de0 0x7fbc781a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 -- 172.21.15.83:0/3981150032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78101e20 msgr2=0x7fbc78199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78101e20 0x7fbc78199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 -- 172.21.15.83:0/3981150032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc781a4780 con 0x7fbc78101470 2024-09-19T09:02:04.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7659c640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc781991c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc68005940 tx=0x7fbc68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:04.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6803f030 con 0x7fbc78101470 2024-09-19T09:02:04.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc68003aa0 con 0x7fbc78101470 2024-09-19T09:02:04.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.697+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc781a4950 con 0x7fbc78101470 2024-09-19T09:02:04.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.698+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68035070 con 0x7fbc78101470 2024-09-19T09:02:04.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.698+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc781a4da0 con 0x7fbc78101470 2024-09-19T09:02:04.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.699+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc78101850 con 0x7fbc78101470 2024-09-19T09:02:04.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.700+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbc68042030 con 0x7fbc78101470 2024-09-19T09:02:04.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.700+0000 7fbc677fe640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbc600a32d0 0x7fbc600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.700+0000 7fbc75d9b640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbc600a32d0 0x7fbc600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.701+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbc680f05b0 con 0x7fbc78101470 2024-09-19T09:02:04.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.701+0000 7fbc75d9b640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbc600a32d0 0x7fbc600a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbc78100c50 tx=0x7fbc6c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:04.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.705+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc680bce10 con 0x7fbc78101470 2024-09-19T09:02:04.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 -- 172.21.15.83:0/1285016642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 msgr2=0x7f447410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1285016642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447410da40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f446c009ca0 tx=0x7f446c02a950 comp rx=0 tx=0).stop 2024-09-19T09:02:04.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 -- 172.21.15.83:0/1285016642 shutdown_connections 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1285016642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447410da40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1285016642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4474102570 0x7f44741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1285016642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 0x7f4474101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 -- 172.21.15.83:0/1285016642 >> 172.21.15.83:0/1285016642 conn(0x7f44740fc7d0 msgr2=0x7f44740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 -- 172.21.15.83:0/1285016642 shutdown_connections 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.614+0000 7f4479b8f640 1 -- 172.21.15.83:0/1285016642 wait complete. 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 Processor -- start 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 -- start start 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 0x7f44741972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4474102570 0x7f44741977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4474110e30 con 0x7f4474102ef0 2024-09-19T09:02:04.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4474110cb0 con 0x7f4474102570 2024-09-19T09:02:04.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4479b8f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4474110fb0 con 0x7f4474100e20 2024-09-19T09:02:04.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4473fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4473fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447419bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58696/0 (socket says 172.21.15.83:58696) 2024-09-19T09:02:04.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4473fff640 1 -- 172.21.15.83:0/1106019651 learned_addr learned my addr 172.21.15.83:0/1106019651 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:04.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.615+0000 7f4472ffd640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4474102570 0x7f44741977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.829 INFO:teuthology.orchestra.run.smithi083.stdout:98784247878 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4473fff640 1 -- 172.21.15.83:0/1106019651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 msgr2=0x7f44741972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f44737fe640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 0x7f44741972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4473fff640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 0x7f44741972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4473fff640 1 -- 172.21.15.83:0/1106019651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4474102570 msgr2=0x7f44741977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4473fff640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4474102570 0x7f44741977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4473fff640 1 -- 172.21.15.83:0/1106019651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447419c250 con 0x7f4474102ef0 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f44737fe640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 0x7f44741972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4473fff640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447419bb70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f446c02ae70 tx=0x7f446c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c034040 con 0x7f4474102ef0 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447419c4e0 con 0x7f4474102ef0 2024-09-19T09:02:04.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f446c0308f0 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c004780 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.616+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447419c9b0 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.617+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4474101200 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.618+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f446c037020 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.619+0000 7f4470ff9640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f445c0a32d0 0x7f445c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.620+0000 7f44737fe640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f445c0a32d0 0x7f445c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.620+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f446c0f2810 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.620+0000 7f44737fe640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f445c0a32d0 0x7f445c0a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44640058c0 tx=0x7f4464005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.627+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f446c040070 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.803+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4474108b00 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.804+0000 7f4470ff9640 1 -- 172.21.15.83:0/1106019651 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f446c0bf010 con 0x7f4474102ef0 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f445c0a32d0 msgr2=0x7f445c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f445c0a32d0 0x7f445c0a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44640058c0 tx=0x7f4464005d30 comp rx=0 tx=0).stop 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 msgr2=0x7f447419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447419bb70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f446c02ae70 tx=0x7f446c02f5d0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 shutdown_connections 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f445c0a32d0 0x7f445c0a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4474102ef0 0x7f447419bb70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4474102570 0x7f44741977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 --2- 172.21.15.83:0/1106019651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4474100e20 0x7f44741972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 >> 172.21.15.83:0/1106019651 conn(0x7f44740fc7d0 msgr2=0x7f44740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 shutdown_connections 2024-09-19T09:02:04.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.806+0000 7f4479b8f640 1 -- 172.21.15.83:0/1106019651 wait complete. 2024-09-19T09:02:04.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.879+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fbc78108fc0 con 0x7fbc78101470 2024-09-19T09:02:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.879+0000 7fbc677fe640 1 -- 172.21.15.83:0/3981150032 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbc680bc710 con 0x7fbc78101470 2024-09-19T09:02:04.880 INFO:teuthology.orchestra.run.smithi083.stdout:236223201326 2024-09-19T09:02:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbc600a32d0 msgr2=0x7fbc600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbc600a32d0 0x7fbc600a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbc78100c50 tx=0x7fbc6c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 msgr2=0x7fbc781991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc781991c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc68005940 tx=0x7fbc68004270 comp rx=0 tx=0).stop 2024-09-19T09:02:04.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 shutdown_connections 2024-09-19T09:02:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fbc600a32d0 0x7fbc600a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc78105de0 0x7fbc781a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc78101e20 0x7fbc78199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 --2- 172.21.15.83:0/3981150032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc78101470 0x7fbc781991c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 >> 172.21.15.83:0/3981150032 conn(0x7fbc78077230 msgr2=0x7fbc780fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:04.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 shutdown_connections 2024-09-19T09:02:04.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:04.881+0000 7fbc7c9d9640 1 -- 172.21.15.83:0/3981150032 wait complete. 2024-09-19T09:02:05.070 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:05 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1106019651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:02:05.070 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:05 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3981150032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:02:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:05 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1106019651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:02:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:05 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3981150032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:02:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:05 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1106019651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:02:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:05 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3981150032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:02:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 -- 172.21.15.83:0/2386315208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 msgr2=0x7fefd410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 --2- 172.21.15.83:0/2386315208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd410da40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fefcc009ca0 tx=0x7fefcc02a950 comp rx=0 tx=0).stop 2024-09-19T09:02:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 -- 172.21.15.83:0/2386315208 shutdown_connections 2024-09-19T09:02:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 --2- 172.21.15.83:0/2386315208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd410da40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 --2- 172.21.15.83:0/2386315208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd4102570 0x7fefd41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 --2- 172.21.15.83:0/2386315208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4100e20 0x7fefd4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 -- 172.21.15.83:0/2386315208 >> 172.21.15.83:0/2386315208 conn(0x7fefd40fc7d0 msgr2=0x7fefd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 -- 172.21.15.83:0/2386315208 shutdown_connections 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 -- 172.21.15.83:0/2386315208 wait complete. 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 Processor -- start 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.769+0000 7fefda46e640 1 -- start start 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefda46e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd4100e20 0x7fefd4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefda46e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4102570 0x7fefd4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefda46e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd4199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefda46e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4110e30 con 0x7fefd4102ef0 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefda46e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4110cb0 con 0x7fefd4102570 2024-09-19T09:02:05.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefda46e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4110fb0 con 0x7fefd4100e20 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd4199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd4199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58718/0 (socket says 172.21.15.83:58718) 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 -- 172.21.15.83:0/2862449183 learned_addr learned my addr 172.21.15.83:0/2862449183 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd3fff640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd4100e20 0x7fefd4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefcbfff640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4102570 0x7fefd4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 -- 172.21.15.83:0/2862449183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd4100e20 msgr2=0x7fefd4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd4100e20 0x7fefd4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 -- 172.21.15.83:0/2862449183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4102570 msgr2=0x7fefd4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4102570 0x7fefd4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 -- 172.21.15.83:0/2862449183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd41a4700 con 0x7fefd4102ef0 2024-09-19T09:02:05.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefcbfff640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4102570 0x7fefd4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd8a0b640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd4199dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefcc004af0 tx=0x7fefcc02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc034040 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefcc0308f0 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.770+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc004670 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.771+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd41a4990 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.771+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd41a4e70 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.771+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd4101200 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.773+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fefcc037020 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.773+0000 7fefd1ffb640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fefc00a32d0 0x7fefc00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.774+0000 7fefd3fff640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fefc00a32d0 0x7fefc00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.774+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fefcc0f0c40 con 0x7fefd4102ef0 2024-09-19T09:02:05.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.774+0000 7fefd3fff640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fefc00a32d0 0x7fefc00a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009bd0 tx=0x7fefc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.778+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefcc0f7080 con 0x7fefd4102ef0 2024-09-19T09:02:05.947 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247876 got 98784247878 for osd.3 2024-09-19T09:02:05.948 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:05.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.950+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fefd4109090 con 0x7fefd4102ef0 2024-09-19T09:02:05.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.950+0000 7fefd1ffb640 1 -- 172.21.15.83:0/2862449183 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefcc0bd5b0 con 0x7fefd4102ef0 2024-09-19T09:02:05.951 INFO:teuthology.orchestra.run.smithi083.stdout:68719476813 2024-09-19T09:02:05.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fefc00a32d0 msgr2=0x7fefc00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fefc00a32d0 0x7fefc00a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009bd0 tx=0x7fefc4005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:05.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 msgr2=0x7fefd4199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd4199dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefcc004af0 tx=0x7fefcc02f5d0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 shutdown_connections 2024-09-19T09:02:05.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fefc00a32d0 0x7fefc00a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fefd4102ef0 0x7fefd4199dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefd4102570 0x7fefd4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 --2- 172.21.15.83:0/2862449183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd4100e20 0x7fefd4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 >> 172.21.15.83:0/2862449183 conn(0x7fefd40fc7d0 msgr2=0x7fefd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 shutdown_connections 2024-09-19T09:02:05.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:05.952+0000 7fefda46e640 1 -- 172.21.15.83:0/2862449183 wait complete. 2024-09-19T09:02:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:06 smithi083 ceph-mon[30926]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:06 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2862449183' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:02:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:06 smithi184 ceph-mon[35007]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:06 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2862449183' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:02:06.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:06 smithi122 ceph-mon[34247]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:06.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:06 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2862449183' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:02:06.972 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593781 got 184683593784 for osd.6 2024-09-19T09:02:06.972 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:07.196 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:07 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2004683338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:02:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2004683338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:02:07.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201323 got 236223201326 for osd.8 2024-09-19T09:02:07.409 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:07.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2004683338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 -- 172.21.15.83:0/3091160440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8101400 msgr2=0x7fe5d810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/3091160440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8101400 0x7fe5d810d930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009cd0 tx=0x7fe5d002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 -- 172.21.15.83:0/3091160440 shutdown_connections 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/3091160440 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8101400 0x7fe5d810d930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/3091160440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d8100a60 0x7fe5d8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/3091160440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5d8106a60 0x7fe5d8106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 -- 172.21.15.83:0/3091160440 >> 172.21.15.83:0/3091160440 conn(0x7fe5d80fc780 msgr2=0x7fe5d80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 -- 172.21.15.83:0/3091160440 shutdown_connections 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.370+0000 7fe5deeb5640 1 -- 172.21.15.83:0/3091160440 wait complete. 2024-09-19T09:02:07.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 Processor -- start 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 -- start start 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 0x7fe5d81990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5d8101400 0x7fe5d8199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d8106a60 0x7fe5d81a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8110d10 con 0x7fe5d8100a60 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8110b90 con 0x7fe5d8106a60 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5deeb5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8110e90 con 0x7fe5d8101400 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 0x7fe5d81990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 0x7fe5d81990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58738/0 (socket says 172.21.15.83:58738) 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 -- 172.21.15.83:0/2004683338 learned_addr learned my addr 172.21.15.83:0/2004683338 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 -- 172.21.15.83:0/2004683338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5d8101400 msgr2=0x7fe5d8199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5d8101400 0x7fe5d8199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 -- 172.21.15.83:0/2004683338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d8106a60 msgr2=0x7fe5d81a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d8106a60 0x7fe5d81a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 -- 172.21.15.83:0/2004683338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d81a46b0 con 0x7fe5d8100a60 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.371+0000 7fe5dcc51640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 0x7fe5d81990f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c920 tx=0x7fe5cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.372+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc007c70 con 0x7fe5d8100a60 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.372+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5cc007e10 con 0x7fe5d8100a60 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.372+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d81a4880 con 0x7fe5d8100a60 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.372+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc018820 con 0x7fe5d8100a60 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.372+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d81a4dc0 con 0x7fe5d8100a60 2024-09-19T09:02:07.527 INFO:teuthology.orchestra.run.smithi083.stdout:270582939689 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.373+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d8100ec0 con 0x7fe5d8100a60 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.374+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe5cc0189c0 con 0x7fe5d8100a60 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.374+0000 7fe5d5ffb640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5c80a3350 0x7fe5c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.374+0000 7fe5d7fff640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5c80a3350 0x7fe5c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.375+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe5cc0cff30 con 0x7fe5d8100a60 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.375+0000 7fe5d7fff640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5c80a3350 0x7fe5c80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4005fd0 tx=0x7fe5c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.379+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5cc014030 con 0x7fe5d8100a60 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.548+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe5d802d810 con 0x7fe5d8100a60 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.548+0000 7fe5d5ffb640 1 -- 172.21.15.83:0/2004683338 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe5cc00de20 con 0x7fe5d8100a60 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5c80a3350 msgr2=0x7fe5c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5c80a3350 0x7fe5c80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4005fd0 tx=0x7fe5c4005850 comp rx=0 tx=0).stop 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 msgr2=0x7fe5d81990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 0x7fe5d81990f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c920 tx=0x7fe5cc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 shutdown_connections 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe5c80a3350 0x7fe5c80a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d8106a60 0x7fe5d81a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5d8101400 0x7fe5d8199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 --2- 172.21.15.83:0/2004683338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8100a60 0x7fe5d81990f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 >> 172.21.15.83:0/2004683338 conn(0x7fe5d80fc780 msgr2=0x7fe5d80fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 shutdown_connections 2024-09-19T09:02:07.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:06.551+0000 7fe5deeb5640 1 -- 172.21.15.83:0/2004683338 wait complete. 2024-09-19T09:02:08.104 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:08 smithi083 ceph-mon[30926]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-19T09:02:08.140 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939686 got 270582939689 for osd.9 2024-09-19T09:02:08.140 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:08 smithi184 ceph-mon[35007]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-19T09:02:08.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:08 smithi122 ceph-mon[34247]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-19T09:02:08.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476811 got 68719476813 for osd.2 2024-09-19T09:02:08.800 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:08.800 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:02:08.800 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:02:09.053 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:09.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 -- 172.21.15.83:0/2582029601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c102790 msgr2=0x7f725c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 --2- 172.21.15.83:0/2582029601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c102790 0x7f725c1067e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7258009900 tx=0x7f725802a410 comp rx=0 tx=0).stop 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 -- 172.21.15.83:0/2582029601 shutdown_connections 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 --2- 172.21.15.83:0/2582029601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f725c106f10 0x7f725c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 --2- 172.21.15.83:0/2582029601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c102790 0x7f725c1067e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 --2- 172.21.15.83:0/2582029601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f725c101de0 0x7f725c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 -- 172.21.15.83:0/2582029601 >> 172.21.15.83:0/2582029601 conn(0x7f725c0fd8c0 msgr2=0x7f725c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 -- 172.21.15.83:0/2582029601 shutdown_connections 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.539+0000 7f726380b640 1 -- 172.21.15.83:0/2582029601 wait complete. 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 Processor -- start 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 -- start start 2024-09-19T09:02:09.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 0x7f725c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f725c102790 0x7f725c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f725c106f10 0x7f725c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f725c111e20 con 0x7f725c101de0 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f725c111ca0 con 0x7f725c106f10 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f726380b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f725c111fa0 con 0x7f725c102790 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f72615a7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 0x7f725c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f72615a7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 0x7f725c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58750/0 (socket says 172.21.15.83:58750) 2024-09-19T09:02:09.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f72615a7640 1 -- 172.21.15.83:0/577800984 learned_addr learned my addr 172.21.15.83:0/577800984 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f7260da6640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f725c102790 0x7f725c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.540+0000 7f7261da8640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f725c106f10 0x7f725c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f72615a7640 1 -- 172.21.15.83:0/577800984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f725c102790 msgr2=0x7f725c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f72615a7640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f725c102790 0x7f725c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f72615a7640 1 -- 172.21.15.83:0/577800984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f725c106f10 msgr2=0x7f725c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f72615a7640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f725c106f10 0x7f725c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f72615a7640 1 -- 172.21.15.83:0/577800984 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725c19d310 con 0x7f725c101de0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f72615a7640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 0x7f725c198360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f725000d950 tx=0x7f725000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250017070 con 0x7f725c101de0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7250009c30 con 0x7f725c101de0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725c19d600 con 0x7f725c101de0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725000f620 con 0x7f725c101de0 2024-09-19T09:02:09.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.541+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725c1a4ee0 con 0x7f725c101de0 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.542+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f725c1021c0 con 0x7f725c101de0 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.543+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f72500109a0 con 0x7f725c101de0 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.544+0000 7f724e7fc640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f72480a3350 0x7f72480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.544+0000 7f7260da6640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f72480a3350 0x7f72480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.544+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f72500cf910 con 0x7f725c101de0 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.544+0000 7f7260da6640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f72480a3350 0x7f72480a5810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7258031440 tx=0x7f7258005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:09.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.548+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7250009de0 con 0x7f725c101de0 2024-09-19T09:02:09.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.711+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f725c062630 con 0x7f72480a3350 2024-09-19T09:02:09.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.719+0000 7f724e7fc640 1 -- 172.21.15.83:0/577800984 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340412 (secure 0 0 0) 0x7f725c062630 con 0x7f72480a3350 2024-09-19T09:02:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:09.726 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f72480a3350 msgr2=0x7f72480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f72480a3350 0x7f72480a5810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7258031440 tx=0x7f7258005b50 comp rx=0 tx=0).stop 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 msgr2=0x7f725c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 0x7f725c198360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f725000d950 tx=0x7f725000de10 comp rx=0 tx=0).stop 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 shutdown_connections 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f72480a3350 0x7f72480a5810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f725c106f10 0x7f725c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f725c102790 0x7f725c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 --2- 172.21.15.83:0/577800984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f725c101de0 0x7f725c198360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 >> 172.21.15.83:0/577800984 conn(0x7f725c0fd8c0 msgr2=0x7f725c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:09.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 shutdown_connections 2024-09-19T09:02:09.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:09.723+0000 7f726380b640 1 -- 172.21.15.83:0/577800984 wait complete. 2024-09-19T09:02:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:10 smithi184 ceph-mon[35007]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:02:10.435 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:10 smithi083 ceph-mon[30926]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:02:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:10 smithi122 ceph-mon[34247]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:02:10.464 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-19T09:02:08.935664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659886,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":684,"num_read_kb":467,"num_write":431,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380088,"kb_used_data":14132,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561736,"statfs":{"total":1151940427776,"available":1151551217664,"internally_reserved":0,"allocated":14471168,"data_stored":8018240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003614"},"pg_stats":[{"pgid":"2.1f","version":"87'13","reported_seq":96,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:02.282262+0000","last_change":"2024-09-19T09:00:35.055195+0000","last_active":"2024-09-19T09:02:02.282262+0000","last_peered":"2024-09-19T09:02:02.282262+0000","last_clean":"2024-09-19T09:02:02.282262+0000","last_became_active":"2024-09-19T09:00:35.054878+0000","last_became_peered":"2024-09-19T09:00:35.054878+0000","last_unstale":"2024-09-19T09:02:02.282262+0000","last_undegraded":"2024-09-19T09:02:02.282262+0000","last_fullsized":"2024-09-19T09:02:02.282262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:40.719595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246079+0000","last_change":"2024-09-19T09:00:37.077470+0000","last_active":"2024-09-19T09:01:45.246079+0000","last_peered":"2024-09-19T09:01:45.246079+0000","last_clean":"2024-09-19T09:01:45.246079+0000","last_became_active":"2024-09-19T09:00:37.077158+0000","last_became_peered":"2024-09-19T09:00:37.077158+0000","last_unstale":"2024-09-19T09:01:45.246079+0000","last_undegraded":"2024-09-19T09:01:45.246079+0000","last_fullsized":"2024-09-19T09:01:45.246079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:00.350496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999600+0000","last_change":"2024-09-19T09:00:44.135294+0000","last_active":"2024-09-19T09:01:44.999600+0000","last_peered":"2024-09-19T09:01:44.999600+0000","last_clean":"2024-09-19T09:01:44.999600+0000","last_became_active":"2024-09-19T09:00:44.134844+0000","last_became_peered":"2024-09-19T09:00:44.134844+0000","last_unstale":"2024-09-19T09:01:44.999600+0000","last_undegraded":"2024-09-19T09:01:44.999600+0000","last_fullsized":"2024-09-19T09:01:44.999600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:06.231954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246287+0000","last_change":"2024-09-19T09:00:35.499941+0000","last_active":"2024-09-19T09:01:45.246287+0000","last_peered":"2024-09-19T09:01:45.246287+0000","last_clean":"2024-09-19T09:01:45.246287+0000","last_became_active":"2024-09-19T09:00:35.499463+0000","last_became_peered":"2024-09-19T09:00:35.499463+0000","last_unstale":"2024-09-19T09:01:45.246287+0000","last_undegraded":"2024-09-19T09:01:45.246287+0000","last_fullsized":"2024-09-19T09:01:45.246287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:15.603127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245413+0000","last_change":"2024-09-19T09:00:37.078318+0000","last_active":"2024-09-19T09:01:45.245413+0000","last_peered":"2024-09-19T09:01:45.245413+0000","last_clean":"2024-09-19T09:01:45.245413+0000","last_became_active":"2024-09-19T09:00:37.078037+0000","last_became_peered":"2024-09-19T09:00:37.078037+0000","last_unstale":"2024-09-19T09:01:45.245413+0000","last_undegraded":"2024-09-19T09:01:45.245413+0000","last_fullsized":"2024-09-19T09:01:45.245413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:41.860274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001581+0000","last_change":"2024-09-19T09:00:44.132012+0000","last_active":"2024-09-19T09:01:45.001581+0000","last_peered":"2024-09-19T09:01:45.001581+0000","last_clean":"2024-09-19T09:01:45.001581+0000","last_became_active":"2024-09-19T09:00:44.131238+0000","last_became_peered":"2024-09-19T09:00:44.131238+0000","last_unstale":"2024-09-19T09:01:45.001581+0000","last_undegraded":"2024-09-19T09:01:45.001581+0000","last_fullsized":"2024-09-19T09:01:45.001581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:07.931510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000500+0000","last_change":"2024-09-19T09:00:35.059882+0000","last_active":"2024-09-19T09:01:45.000500+0000","last_peered":"2024-09-19T09:01:45.000500+0000","last_clean":"2024-09-19T09:01:45.000500+0000","last_became_active":"2024-09-19T09:00:35.059467+0000","last_became_peered":"2024-09-19T09:00:35.059467+0000","last_unstale":"2024-09-19T09:01:45.000500+0000","last_undegraded":"2024-09-19T09:01:45.000500+0000","last_fullsized":"2024-09-19T09:01:45.000500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:59.309282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000047+0000","last_change":"2024-09-19T09:00:37.078097+0000","last_active":"2024-09-19T09:01:45.000047+0000","last_peered":"2024-09-19T09:01:45.000047+0000","last_clean":"2024-09-19T09:01:45.000047+0000","last_became_active":"2024-09-19T09:00:37.077770+0000","last_became_peered":"2024-09-19T09:00:37.077770+0000","last_unstale":"2024-09-19T09:01:45.000047+0000","last_undegraded":"2024-09-19T09:01:45.000047+0000","last_fullsized":"2024-09-19T09:01:45.000047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:57.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002075+0000","last_change":"2024-09-19T09:00:44.128702+0000","last_active":"2024-09-19T09:01:45.002075+0000","last_peered":"2024-09-19T09:01:45.002075+0000","last_clean":"2024-09-19T09:01:45.002075+0000","last_became_active":"2024-09-19T09:00:44.128324+0000","last_became_peered":"2024-09-19T09:00:44.128324+0000","last_unstale":"2024-09-19T09:01:45.002075+0000","last_undegraded":"2024-09-19T09:01:45.002075+0000","last_fullsized":"2024-09-19T09:01:45.002075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:43.165912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001454+0000","last_change":"2024-09-19T09:00:35.057840+0000","last_active":"2024-09-19T09:01:45.001454+0000","last_peered":"2024-09-19T09:01:45.001454+0000","last_clean":"2024-09-19T09:01:45.001454+0000","last_became_active":"2024-09-19T09:00:35.057458+0000","last_became_peered":"2024-09-19T09:00:35.057458+0000","last_unstale":"2024-09-19T09:01:45.001454+0000","last_undegraded":"2024-09-19T09:01:45.001454+0000","last_fullsized":"2024-09-19T09:01:45.001454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:40.393892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240203+0000","last_change":"2024-09-19T09:00:37.082885+0000","last_active":"2024-09-19T09:01:45.240203+0000","last_peered":"2024-09-19T09:01:45.240203+0000","last_clean":"2024-09-19T09:01:45.240203+0000","last_became_active":"2024-09-19T09:00:37.082494+0000","last_became_peered":"2024-09-19T09:00:37.082494+0000","last_unstale":"2024-09-19T09:01:45.240203+0000","last_undegraded":"2024-09-19T09:01:45.240203+0000","last_fullsized":"2024-09-19T09:01:45.240203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:47.795093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.247623+0000","last_change":"2024-09-19T09:01:45.247623+0000","last_active":"2024-09-19T09:01:45.247623+0000","last_peered":"2024-09-19T09:01:45.247623+0000","last_clean":"2024-09-19T09:01:45.247623+0000","last_became_active":"2024-09-19T09:01:45.247195+0000","last_became_peered":"2024-09-19T09:01:45.247195+0000","last_unstale":"2024-09-19T09:01:45.247623+0000","last_undegraded":"2024-09-19T09:01:45.247623+0000","last_fullsized":"2024-09-19T09:01:45.247623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:03.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260493+0000","last_change":"2024-09-19T09:00:37.079297+0000","last_active":"2024-09-19T09:01:45.260493+0000","last_peered":"2024-09-19T09:01:45.260493+0000","last_clean":"2024-09-19T09:01:45.260493+0000","last_became_active":"2024-09-19T09:00:37.078949+0000","last_became_peered":"2024-09-19T09:00:37.078949+0000","last_unstale":"2024-09-19T09:01:45.260493+0000","last_undegraded":"2024-09-19T09:01:45.260493+0000","last_fullsized":"2024-09-19T09:01:45.260493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:33.823014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000977+0000","last_change":"2024-09-19T09:00:35.058467+0000","last_active":"2024-09-19T09:01:45.000977+0000","last_peered":"2024-09-19T09:01:45.000977+0000","last_clean":"2024-09-19T09:01:45.000977+0000","last_became_active":"2024-09-19T09:00:35.058103+0000","last_became_peered":"2024-09-19T09:00:35.058103+0000","last_unstale":"2024-09-19T09:01:45.000977+0000","last_undegraded":"2024-09-19T09:01:45.000977+0000","last_fullsized":"2024-09-19T09:01:45.000977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:29.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002279+0000","last_change":"2024-09-19T09:00:44.129381+0000","last_active":"2024-09-19T09:01:45.002279+0000","last_peered":"2024-09-19T09:01:45.002279+0000","last_clean":"2024-09-19T09:01:45.002279+0000","last_became_active":"2024-09-19T09:00:44.128984+0000","last_became_peered":"2024-09-19T09:00:44.128984+0000","last_unstale":"2024-09-19T09:01:45.002279+0000","last_undegraded":"2024-09-19T09:01:45.002279+0000","last_fullsized":"2024-09-19T09:01:45.002279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:28.427607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245648+0000","last_change":"2024-09-19T09:00:37.066684+0000","last_active":"2024-09-19T09:01:45.245648+0000","last_peered":"2024-09-19T09:01:45.245648+0000","last_clean":"2024-09-19T09:01:45.245648+0000","last_became_active":"2024-09-19T09:00:37.066401+0000","last_became_peered":"2024-09-19T09:00:37.066401+0000","last_unstale":"2024-09-19T09:01:45.245648+0000","last_undegraded":"2024-09-19T09:01:45.245648+0000","last_fullsized":"2024-09-19T09:01:45.245648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:54.344499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244830+0000","last_change":"2024-09-19T09:00:44.123394+0000","last_active":"2024-09-19T09:01:45.244830+0000","last_peered":"2024-09-19T09:01:45.244830+0000","last_clean":"2024-09-19T09:01:45.244830+0000","last_became_active":"2024-09-19T09:00:44.122905+0000","last_became_peered":"2024-09-19T09:00:44.122905+0000","last_unstale":"2024-09-19T09:01:45.244830+0000","last_undegraded":"2024-09-19T09:01:45.244830+0000","last_fullsized":"2024-09-19T09:01:45.244830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.852333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001579+0000","last_change":"2024-09-19T09:00:44.134493+0000","last_active":"2024-09-19T09:01:45.001579+0000","last_peered":"2024-09-19T09:01:45.001579+0000","last_clean":"2024-09-19T09:01:45.001579+0000","last_became_active":"2024-09-19T09:00:44.133991+0000","last_became_peered":"2024-09-19T09:00:44.133991+0000","last_unstale":"2024-09-19T09:01:45.001579+0000","last_undegraded":"2024-09-19T09:01:45.001579+0000","last_fullsized":"2024-09-19T09:01:45.001579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:08.981672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244850+0000","last_change":"2024-09-19T09:00:37.077400+0000","last_active":"2024-09-19T09:01:45.244850+0000","last_peered":"2024-09-19T09:01:45.244850+0000","last_clean":"2024-09-19T09:01:45.244850+0000","last_became_active":"2024-09-19T09:00:37.077065+0000","last_became_peered":"2024-09-19T09:00:37.077065+0000","last_unstale":"2024-09-19T09:01:45.244850+0000","last_undegraded":"2024-09-19T09:01:45.244850+0000","last_fullsized":"2024-09-19T09:01:45.244850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:59.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245481+0000","last_change":"2024-09-19T09:00:35.053074+0000","last_active":"2024-09-19T09:01:45.245481+0000","last_peered":"2024-09-19T09:01:45.245481+0000","last_clean":"2024-09-19T09:01:45.245481+0000","last_became_active":"2024-09-19T09:00:35.052574+0000","last_became_peered":"2024-09-19T09:00:35.052574+0000","last_unstale":"2024-09-19T09:01:45.245481+0000","last_undegraded":"2024-09-19T09:01:45.245481+0000","last_fullsized":"2024-09-19T09:01:45.245481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:25.762622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998374+0000","last_change":"2024-09-19T09:00:44.132931+0000","last_active":"2024-09-19T09:01:44.998374+0000","last_peered":"2024-09-19T09:01:44.998374+0000","last_clean":"2024-09-19T09:01:44.998374+0000","last_became_active":"2024-09-19T09:00:44.132397+0000","last_became_peered":"2024-09-19T09:00:44.132397+0000","last_unstale":"2024-09-19T09:01:44.998374+0000","last_undegraded":"2024-09-19T09:01:44.998374+0000","last_fullsized":"2024-09-19T09:01:44.998374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.962417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000249+0000","last_change":"2024-09-19T09:00:37.077233+0000","last_active":"2024-09-19T09:01:45.000249+0000","last_peered":"2024-09-19T09:01:45.000249+0000","last_clean":"2024-09-19T09:01:45.000249+0000","last_became_active":"2024-09-19T09:00:37.076855+0000","last_became_peered":"2024-09-19T09:00:37.076855+0000","last_unstale":"2024-09-19T09:01:45.000249+0000","last_undegraded":"2024-09-19T09:01:45.000249+0000","last_fullsized":"2024-09-19T09:01:45.000249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:32.794488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999721+0000","last_change":"2024-09-19T09:00:35.501157+0000","last_active":"2024-09-19T09:01:44.999721+0000","last_peered":"2024-09-19T09:01:44.999721+0000","last_clean":"2024-09-19T09:01:44.999721+0000","last_became_active":"2024-09-19T09:00:35.500869+0000","last_became_peered":"2024-09-19T09:00:35.500869+0000","last_unstale":"2024-09-19T09:01:44.999721+0000","last_undegraded":"2024-09-19T09:01:44.999721+0000","last_fullsized":"2024-09-19T09:01:44.999721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:44.333496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001420+0000","last_change":"2024-09-19T09:00:44.131479+0000","last_active":"2024-09-19T09:01:45.001420+0000","last_peered":"2024-09-19T09:01:45.001420+0000","last_clean":"2024-09-19T09:01:45.001420+0000","last_became_active":"2024-09-19T09:00:44.131058+0000","last_became_peered":"2024-09-19T09:00:44.131058+0000","last_unstale":"2024-09-19T09:01:45.001420+0000","last_undegraded":"2024-09-19T09:01:45.001420+0000","last_fullsized":"2024-09-19T09:01:45.001420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.980874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245413+0000","last_change":"2024-09-19T09:00:37.076590+0000","last_active":"2024-09-19T09:01:45.245413+0000","last_peered":"2024-09-19T09:01:45.245413+0000","last_clean":"2024-09-19T09:01:45.245413+0000","last_became_active":"2024-09-19T09:00:37.076287+0000","last_became_peered":"2024-09-19T09:00:37.076287+0000","last_unstale":"2024-09-19T09:01:45.245413+0000","last_undegraded":"2024-09-19T09:01:45.245413+0000","last_fullsized":"2024-09-19T09:01:45.245413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:22.237571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002908+0000","last_change":"2024-09-19T09:00:35.733174+0000","last_active":"2024-09-19T09:01:45.002908+0000","last_peered":"2024-09-19T09:01:45.002908+0000","last_clean":"2024-09-19T09:01:45.002908+0000","last_became_active":"2024-09-19T09:00:35.732824+0000","last_became_peered":"2024-09-19T09:00:35.732824+0000","last_unstale":"2024-09-19T09:01:45.002908+0000","last_undegraded":"2024-09-19T09:01:45.002908+0000","last_fullsized":"2024-09-19T09:01:45.002908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:15.143792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999629+0000","last_change":"2024-09-19T09:00:44.137095+0000","last_active":"2024-09-19T09:01:44.999629+0000","last_peered":"2024-09-19T09:01:44.999629+0000","last_clean":"2024-09-19T09:01:44.999629+0000","last_became_active":"2024-09-19T09:00:44.136697+0000","last_became_peered":"2024-09-19T09:00:44.136697+0000","last_unstale":"2024-09-19T09:01:44.999629+0000","last_undegraded":"2024-09-19T09:01:44.999629+0000","last_fullsized":"2024-09-19T09:01:44.999629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:14.316016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245873+0000","last_change":"2024-09-19T09:00:37.074155+0000","last_active":"2024-09-19T09:01:45.245873+0000","last_peered":"2024-09-19T09:01:45.245873+0000","last_clean":"2024-09-19T09:01:45.245873+0000","last_became_active":"2024-09-19T09:00:37.073819+0000","last_became_peered":"2024-09-19T09:00:37.073819+0000","last_unstale":"2024-09-19T09:01:45.245873+0000","last_undegraded":"2024-09-19T09:01:45.245873+0000","last_fullsized":"2024-09-19T09:01:45.245873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:18.598437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998396+0000","last_change":"2024-09-19T09:00:35.055231+0000","last_active":"2024-09-19T09:01:44.998396+0000","last_peered":"2024-09-19T09:01:44.998396+0000","last_clean":"2024-09-19T09:01:44.998396+0000","last_became_active":"2024-09-19T09:00:35.054915+0000","last_became_peered":"2024-09-19T09:00:35.054915+0000","last_unstale":"2024-09-19T09:01:44.998396+0000","last_undegraded":"2024-09-19T09:01:44.998396+0000","last_fullsized":"2024-09-19T09:01:44.998396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:27.730738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245985+0000","last_change":"2024-09-19T09:00:44.134600+0000","last_active":"2024-09-19T09:01:45.245985+0000","last_peered":"2024-09-19T09:01:45.245985+0000","last_clean":"2024-09-19T09:01:45.245985+0000","last_became_active":"2024-09-19T09:00:44.134274+0000","last_became_peered":"2024-09-19T09:00:44.134274+0000","last_unstale":"2024-09-19T09:01:45.245985+0000","last_undegraded":"2024-09-19T09:01:45.245985+0000","last_fullsized":"2024-09-19T09:01:45.245985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:07.172654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246635+0000","last_change":"2024-09-19T09:00:37.075695+0000","last_active":"2024-09-19T09:01:45.246635+0000","last_peered":"2024-09-19T09:01:45.246635+0000","last_clean":"2024-09-19T09:01:45.246635+0000","last_became_active":"2024-09-19T09:00:37.075395+0000","last_became_peered":"2024-09-19T09:00:37.075395+0000","last_unstale":"2024-09-19T09:01:45.246635+0000","last_undegraded":"2024-09-19T09:01:45.246635+0000","last_fullsized":"2024-09-19T09:01:45.246635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.105953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000636+0000","last_change":"2024-09-19T09:00:35.502029+0000","last_active":"2024-09-19T09:01:45.000636+0000","last_peered":"2024-09-19T09:01:45.000636+0000","last_clean":"2024-09-19T09:01:45.000636+0000","last_became_active":"2024-09-19T09:00:35.501535+0000","last_became_peered":"2024-09-19T09:00:35.501535+0000","last_unstale":"2024-09-19T09:01:45.000636+0000","last_undegraded":"2024-09-19T09:01:45.000636+0000","last_fullsized":"2024-09-19T09:01:45.000636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:12.104470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244860+0000","last_change":"2024-09-19T09:00:44.134361+0000","last_active":"2024-09-19T09:01:45.244860+0000","last_peered":"2024-09-19T09:01:45.244860+0000","last_clean":"2024-09-19T09:01:45.244860+0000","last_became_active":"2024-09-19T09:00:44.133859+0000","last_became_peered":"2024-09-19T09:00:44.133859+0000","last_unstale":"2024-09-19T09:01:45.244860+0000","last_undegraded":"2024-09-19T09:01:45.244860+0000","last_fullsized":"2024-09-19T09:01:45.244860+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:29.075555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999646+0000","last_change":"2024-09-19T09:00:37.067259+0000","last_active":"2024-09-19T09:01:44.999646+0000","last_peered":"2024-09-19T09:01:44.999646+0000","last_clean":"2024-09-19T09:01:44.999646+0000","last_became_active":"2024-09-19T09:00:37.066932+0000","last_became_peered":"2024-09-19T09:00:37.066932+0000","last_unstale":"2024-09-19T09:01:44.999646+0000","last_undegraded":"2024-09-19T09:01:44.999646+0000","last_fullsized":"2024-09-19T09:01:44.999646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:09.205551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998439+0000","last_change":"2024-09-19T09:00:35.501139+0000","last_active":"2024-09-19T09:01:44.998439+0000","last_peered":"2024-09-19T09:01:44.998439+0000","last_clean":"2024-09-19T09:01:44.998439+0000","last_became_active":"2024-09-19T09:00:35.500790+0000","last_became_peered":"2024-09-19T09:00:35.500790+0000","last_unstale":"2024-09-19T09:01:44.998439+0000","last_undegraded":"2024-09-19T09:01:44.998439+0000","last_fullsized":"2024-09-19T09:01:44.998439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:51.811772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000368+0000","last_change":"2024-09-19T09:00:44.130524+0000","last_active":"2024-09-19T09:01:45.000368+0000","last_peered":"2024-09-19T09:01:45.000368+0000","last_clean":"2024-09-19T09:01:45.000368+0000","last_became_active":"2024-09-19T09:00:44.130002+0000","last_became_peered":"2024-09-19T09:00:44.130002+0000","last_unstale":"2024-09-19T09:01:45.000368+0000","last_undegraded":"2024-09-19T09:01:45.000368+0000","last_fullsized":"2024-09-19T09:01:45.000368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:35.060388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999904+0000","last_change":"2024-09-19T09:00:44.128716+0000","last_active":"2024-09-19T09:01:44.999904+0000","last_peered":"2024-09-19T09:01:44.999904+0000","last_clean":"2024-09-19T09:01:44.999904+0000","last_became_active":"2024-09-19T09:00:44.128295+0000","last_became_peered":"2024-09-19T09:00:44.128295+0000","last_unstale":"2024-09-19T09:01:44.999904+0000","last_undegraded":"2024-09-19T09:01:44.999904+0000","last_fullsized":"2024-09-19T09:01:44.999904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:55.576207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:02.282819+0000","last_change":"2024-09-19T09:00:35.057111+0000","last_active":"2024-09-19T09:02:02.282819+0000","last_peered":"2024-09-19T09:02:02.282819+0000","last_clean":"2024-09-19T09:02:02.282819+0000","last_became_active":"2024-09-19T09:00:35.056761+0000","last_became_peered":"2024-09-19T09:00:35.056761+0000","last_unstale":"2024-09-19T09:02:02.282819+0000","last_undegraded":"2024-09-19T09:02:02.282819+0000","last_fullsized":"2024-09-19T09:02:02.282819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:22.222798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246391+0000","last_change":"2024-09-19T09:00:44.130871+0000","last_active":"2024-09-19T09:01:45.246391+0000","last_peered":"2024-09-19T09:01:45.246391+0000","last_clean":"2024-09-19T09:01:45.246391+0000","last_became_active":"2024-09-19T09:00:44.130481+0000","last_became_peered":"2024-09-19T09:00:44.130481+0000","last_unstale":"2024-09-19T09:01:45.246391+0000","last_undegraded":"2024-09-19T09:01:45.246391+0000","last_fullsized":"2024-09-19T09:01:45.246391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:47.312776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239699+0000","last_change":"2024-09-19T09:00:37.077325+0000","last_active":"2024-09-19T09:01:45.239699+0000","last_peered":"2024-09-19T09:01:45.239699+0000","last_clean":"2024-09-19T09:01:45.239699+0000","last_became_active":"2024-09-19T09:00:37.076979+0000","last_became_peered":"2024-09-19T09:00:37.076979+0000","last_unstale":"2024-09-19T09:01:45.239699+0000","last_undegraded":"2024-09-19T09:01:45.239699+0000","last_fullsized":"2024-09-19T09:01:45.239699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:25.367304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":93,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:06.277218+0000","last_change":"2024-09-19T09:00:35.499862+0000","last_active":"2024-09-19T09:02:06.277218+0000","last_peered":"2024-09-19T09:02:06.277218+0000","last_clean":"2024-09-19T09:02:06.277218+0000","last_became_active":"2024-09-19T09:00:35.499534+0000","last_became_peered":"2024-09-19T09:00:35.499534+0000","last_unstale":"2024-09-19T09:02:06.277218+0000","last_undegraded":"2024-09-19T09:02:06.277218+0000","last_fullsized":"2024-09-19T09:02:06.277218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:21.008440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246296+0000","last_change":"2024-09-19T09:00:44.135298+0000","last_active":"2024-09-19T09:01:45.246296+0000","last_peered":"2024-09-19T09:01:45.246296+0000","last_clean":"2024-09-19T09:01:45.246296+0000","last_became_active":"2024-09-19T09:00:44.134899+0000","last_became_peered":"2024-09-19T09:00:44.134899+0000","last_unstale":"2024-09-19T09:01:45.246296+0000","last_undegraded":"2024-09-19T09:01:45.246296+0000","last_fullsized":"2024-09-19T09:01:45.246296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244984+0000","last_change":"2024-09-19T09:00:37.076195+0000","last_active":"2024-09-19T09:01:45.244984+0000","last_peered":"2024-09-19T09:01:45.244984+0000","last_clean":"2024-09-19T09:01:45.244984+0000","last_became_active":"2024-09-19T09:00:37.075906+0000","last_became_peered":"2024-09-19T09:00:37.075906+0000","last_unstale":"2024-09-19T09:01:45.244984+0000","last_undegraded":"2024-09-19T09:01:45.244984+0000","last_fullsized":"2024-09-19T09:01:45.244984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:47.724434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260427+0000","last_change":"2024-09-19T09:00:35.059862+0000","last_active":"2024-09-19T09:01:45.260427+0000","last_peered":"2024-09-19T09:01:45.260427+0000","last_clean":"2024-09-19T09:01:45.260427+0000","last_became_active":"2024-09-19T09:00:35.058944+0000","last_became_peered":"2024-09-19T09:00:35.058944+0000","last_unstale":"2024-09-19T09:01:45.260427+0000","last_undegraded":"2024-09-19T09:01:45.260427+0000","last_fullsized":"2024-09-19T09:01:45.260427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:00.233367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240289+0000","last_change":"2024-09-19T09:00:44.133451+0000","last_active":"2024-09-19T09:01:45.240289+0000","last_peered":"2024-09-19T09:01:45.240289+0000","last_clean":"2024-09-19T09:01:45.240289+0000","last_became_active":"2024-09-19T09:00:44.133069+0000","last_became_peered":"2024-09-19T09:00:44.133069+0000","last_unstale":"2024-09-19T09:01:45.240289+0000","last_undegraded":"2024-09-19T09:01:45.240289+0000","last_fullsized":"2024-09-19T09:01:45.240289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:22.890861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998053+0000","last_change":"2024-09-19T09:00:44.132394+0000","last_active":"2024-09-19T09:01:44.998053+0000","last_peered":"2024-09-19T09:01:44.998053+0000","last_clean":"2024-09-19T09:01:44.998053+0000","last_became_active":"2024-09-19T09:00:44.132050+0000","last_became_peered":"2024-09-19T09:00:44.132050+0000","last_unstale":"2024-09-19T09:01:44.998053+0000","last_undegraded":"2024-09-19T09:01:44.998053+0000","last_fullsized":"2024-09-19T09:01:44.998053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:12.963885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002241+0000","last_change":"2024-09-19T09:00:35.055179+0000","last_active":"2024-09-19T09:01:45.002241+0000","last_peered":"2024-09-19T09:01:45.002241+0000","last_clean":"2024-09-19T09:01:45.002241+0000","last_became_active":"2024-09-19T09:00:35.054788+0000","last_became_peered":"2024-09-19T09:00:35.054788+0000","last_unstale":"2024-09-19T09:01:45.002241+0000","last_undegraded":"2024-09-19T09:01:45.002241+0000","last_fullsized":"2024-09-19T09:01:45.002241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:50.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":359,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260570+0000","last_change":"2024-09-19T08:59:22.943778+0000","last_active":"2024-09-19T09:01:45.260570+0000","last_peered":"2024-09-19T09:01:45.260570+0000","last_clean":"2024-09-19T09:01:45.260570+0000","last_became_active":"2024-09-19T08:59:22.943357+0000","last_became_peered":"2024-09-19T08:59:22.943357+0000","last_unstale":"2024-09-19T09:01:45.260570+0000","last_undegraded":"2024-09-19T09:01:45.260570+0000","last_fullsized":"2024-09-19T09:01:45.260570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_clean_scrub_stamp":"2024-09-19T08:55:57.183363+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:02.301026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260842+0000","last_change":"2024-09-19T09:00:44.135446+0000","last_active":"2024-09-19T09:01:45.260842+0000","last_peered":"2024-09-19T09:01:45.260842+0000","last_clean":"2024-09-19T09:01:45.260842+0000","last_became_active":"2024-09-19T09:00:44.135030+0000","last_became_peered":"2024-09-19T09:00:44.135030+0000","last_unstale":"2024-09-19T09:01:45.260842+0000","last_undegraded":"2024-09-19T09:01:45.260842+0000","last_fullsized":"2024-09-19T09:01:45.260842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:13.588934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.261065+0000","last_change":"2024-09-19T09:00:37.079569+0000","last_active":"2024-09-19T09:01:45.261065+0000","last_peered":"2024-09-19T09:01:45.261065+0000","last_clean":"2024-09-19T09:01:45.261065+0000","last_became_active":"2024-09-19T09:00:37.079089+0000","last_became_peered":"2024-09-19T09:00:37.079089+0000","last_unstale":"2024-09-19T09:01:45.261065+0000","last_undegraded":"2024-09-19T09:01:45.261065+0000","last_fullsized":"2024-09-19T09:01:45.261065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:56.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":79,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:06.256395+0000","last_change":"2024-09-19T09:00:44.125607+0000","last_active":"2024-09-19T09:02:06.256395+0000","last_peered":"2024-09-19T09:02:06.256395+0000","last_clean":"2024-09-19T09:02:06.256395+0000","last_became_active":"2024-09-19T09:00:44.125236+0000","last_became_peered":"2024-09-19T09:00:44.125236+0000","last_unstale":"2024-09-19T09:02:06.256395+0000","last_undegraded":"2024-09-19T09:02:06.256395+0000","last_fullsized":"2024-09-19T09:02:06.256395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:21.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999408+0000","last_change":"2024-09-19T09:00:44.136886+0000","last_active":"2024-09-19T09:01:44.999408+0000","last_peered":"2024-09-19T09:01:44.999408+0000","last_clean":"2024-09-19T09:01:44.999408+0000","last_became_active":"2024-09-19T09:00:44.136394+0000","last_became_peered":"2024-09-19T09:00:44.136394+0000","last_unstale":"2024-09-19T09:01:44.999408+0000","last_undegraded":"2024-09-19T09:01:44.999408+0000","last_fullsized":"2024-09-19T09:01:44.999408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.680203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260771+0000","last_change":"2024-09-19T09:00:37.081017+0000","last_active":"2024-09-19T09:01:45.260771+0000","last_peered":"2024-09-19T09:01:45.260771+0000","last_clean":"2024-09-19T09:01:45.260771+0000","last_became_active":"2024-09-19T09:00:37.080674+0000","last_became_peered":"2024-09-19T09:00:37.080674+0000","last_unstale":"2024-09-19T09:01:45.260771+0000","last_undegraded":"2024-09-19T09:01:45.260771+0000","last_fullsized":"2024-09-19T09:01:45.260771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:07.247315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240472+0000","last_change":"2024-09-19T09:00:35.056009+0000","last_active":"2024-09-19T09:01:45.240472+0000","last_peered":"2024-09-19T09:01:45.240472+0000","last_clean":"2024-09-19T09:01:45.240472+0000","last_became_active":"2024-09-19T09:00:35.055651+0000","last_became_peered":"2024-09-19T09:00:35.055651+0000","last_unstale":"2024-09-19T09:01:45.240472+0000","last_undegraded":"2024-09-19T09:01:45.240472+0000","last_fullsized":"2024-09-19T09:01:45.240472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:36.726272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245558+0000","last_change":"2024-09-19T09:00:44.135629+0000","last_active":"2024-09-19T09:01:45.245558+0000","last_peered":"2024-09-19T09:01:45.245558+0000","last_clean":"2024-09-19T09:01:45.245558+0000","last_became_active":"2024-09-19T09:00:44.135253+0000","last_became_peered":"2024-09-19T09:00:44.135253+0000","last_unstale":"2024-09-19T09:01:45.245558+0000","last_undegraded":"2024-09-19T09:01:45.245558+0000","last_fullsized":"2024-09-19T09:01:45.245558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:37.767455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260914+0000","last_change":"2024-09-19T09:00:37.084042+0000","last_active":"2024-09-19T09:01:45.260914+0000","last_peered":"2024-09-19T09:01:45.260914+0000","last_clean":"2024-09-19T09:01:45.260914+0000","last_became_active":"2024-09-19T09:00:37.083512+0000","last_became_peered":"2024-09-19T09:00:37.083512+0000","last_unstale":"2024-09-19T09:01:45.260914+0000","last_undegraded":"2024-09-19T09:01:45.260914+0000","last_fullsized":"2024-09-19T09:01:45.260914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:07.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246666+0000","last_change":"2024-09-19T09:00:35.056202+0000","last_active":"2024-09-19T09:01:45.246666+0000","last_peered":"2024-09-19T09:01:45.246666+0000","last_clean":"2024-09-19T09:01:45.246666+0000","last_became_active":"2024-09-19T09:00:35.055867+0000","last_became_peered":"2024-09-19T09:00:35.055867+0000","last_unstale":"2024-09-19T09:01:45.246666+0000","last_undegraded":"2024-09-19T09:01:45.246666+0000","last_fullsized":"2024-09-19T09:01:45.246666+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:08.852400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239571+0000","last_change":"2024-09-19T09:00:44.133928+0000","last_active":"2024-09-19T09:01:45.239571+0000","last_peered":"2024-09-19T09:01:45.239571+0000","last_clean":"2024-09-19T09:01:45.239571+0000","last_became_active":"2024-09-19T09:00:44.133077+0000","last_became_peered":"2024-09-19T09:00:44.133077+0000","last_unstale":"2024-09-19T09:01:45.239571+0000","last_undegraded":"2024-09-19T09:01:45.239571+0000","last_fullsized":"2024-09-19T09:01:45.239571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:37.349942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245229+0000","last_change":"2024-09-19T09:00:37.080009+0000","last_active":"2024-09-19T09:01:45.245229+0000","last_peered":"2024-09-19T09:01:45.245229+0000","last_clean":"2024-09-19T09:01:45.245229+0000","last_became_active":"2024-09-19T09:00:37.079291+0000","last_became_peered":"2024-09-19T09:00:37.079291+0000","last_unstale":"2024-09-19T09:01:45.245229+0000","last_undegraded":"2024-09-19T09:01:45.245229+0000","last_fullsized":"2024-09-19T09:01:45.245229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:59.095093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001267+0000","last_change":"2024-09-19T09:00:35.058866+0000","last_active":"2024-09-19T09:01:45.001267+0000","last_peered":"2024-09-19T09:01:45.001267+0000","last_clean":"2024-09-19T09:01:45.001267+0000","last_became_active":"2024-09-19T09:00:35.058318+0000","last_became_peered":"2024-09-19T09:00:35.058318+0000","last_unstale":"2024-09-19T09:01:45.001267+0000","last_undegraded":"2024-09-19T09:01:45.001267+0000","last_fullsized":"2024-09-19T09:01:45.001267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:32.183063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239614+0000","last_change":"2024-09-19T09:00:44.136564+0000","last_active":"2024-09-19T09:01:45.239614+0000","last_peered":"2024-09-19T09:01:45.239614+0000","last_clean":"2024-09-19T09:01:45.239614+0000","last_became_active":"2024-09-19T09:00:44.136192+0000","last_became_peered":"2024-09-19T09:00:44.136192+0000","last_unstale":"2024-09-19T09:01:45.239614+0000","last_undegraded":"2024-09-19T09:01:45.239614+0000","last_fullsized":"2024-09-19T09:01:45.239614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:17.856055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239775+0000","last_change":"2024-09-19T09:00:37.079611+0000","last_active":"2024-09-19T09:01:45.239775+0000","last_peered":"2024-09-19T09:01:45.239775+0000","last_clean":"2024-09-19T09:01:45.239775+0000","last_became_active":"2024-09-19T09:00:37.079135+0000","last_became_peered":"2024-09-19T09:00:37.079135+0000","last_unstale":"2024-09-19T09:01:45.239775+0000","last_undegraded":"2024-09-19T09:01:45.239775+0000","last_fullsized":"2024-09-19T09:01:45.239775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.321754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244683+0000","last_change":"2024-09-19T09:00:44.144312+0000","last_active":"2024-09-19T09:01:45.244683+0000","last_peered":"2024-09-19T09:01:45.244683+0000","last_clean":"2024-09-19T09:01:45.244683+0000","last_became_active":"2024-09-19T09:00:44.128920+0000","last_became_peered":"2024-09-19T09:00:44.128920+0000","last_unstale":"2024-09-19T09:01:45.244683+0000","last_undegraded":"2024-09-19T09:01:45.244683+0000","last_fullsized":"2024-09-19T09:01:45.244683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:06.640129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246565+0000","last_change":"2024-09-19T09:00:44.134009+0000","last_active":"2024-09-19T09:01:45.246565+0000","last_peered":"2024-09-19T09:01:45.246565+0000","last_clean":"2024-09-19T09:01:45.246565+0000","last_became_active":"2024-09-19T09:00:44.133634+0000","last_became_peered":"2024-09-19T09:00:44.133634+0000","last_unstale":"2024-09-19T09:01:45.246565+0000","last_undegraded":"2024-09-19T09:01:45.246565+0000","last_fullsized":"2024-09-19T09:01:45.246565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.591618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260305+0000","last_change":"2024-09-19T09:00:37.082614+0000","last_active":"2024-09-19T09:01:45.260305+0000","last_peered":"2024-09-19T09:01:45.260305+0000","last_clean":"2024-09-19T09:01:45.260305+0000","last_became_active":"2024-09-19T09:00:37.082316+0000","last_became_peered":"2024-09-19T09:00:37.082316+0000","last_unstale":"2024-09-19T09:01:45.260305+0000","last_undegraded":"2024-09-19T09:01:45.260305+0000","last_fullsized":"2024-09-19T09:01:45.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:21.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":96,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:06.277943+0000","last_change":"2024-09-19T09:00:35.057270+0000","last_active":"2024-09-19T09:02:06.277943+0000","last_peered":"2024-09-19T09:02:06.277943+0000","last_clean":"2024-09-19T09:02:06.277943+0000","last_became_active":"2024-09-19T09:00:35.056955+0000","last_became_peered":"2024-09-19T09:00:35.056955+0000","last_unstale":"2024-09-19T09:02:06.277943+0000","last_undegraded":"2024-09-19T09:02:06.277943+0000","last_fullsized":"2024-09-19T09:02:06.277943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:11.609975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.262086+0000","last_change":"2024-09-19T09:01:45.262086+0000","last_active":"2024-09-19T09:01:45.262086+0000","last_peered":"2024-09-19T09:01:45.262086+0000","last_clean":"2024-09-19T09:01:45.262086+0000","last_became_active":"2024-09-19T09:01:45.261708+0000","last_became_peered":"2024-09-19T09:01:45.261708+0000","last_unstale":"2024-09-19T09:01:45.262086+0000","last_undegraded":"2024-09-19T09:01:45.262086+0000","last_fullsized":"2024-09-19T09:01:45.262086+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:09.056725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260759+0000","last_change":"2024-09-19T09:00:37.076171+0000","last_active":"2024-09-19T09:01:45.260759+0000","last_peered":"2024-09-19T09:01:45.260759+0000","last_clean":"2024-09-19T09:01:45.260759+0000","last_became_active":"2024-09-19T09:00:37.074936+0000","last_became_peered":"2024-09-19T09:00:37.074936+0000","last_unstale":"2024-09-19T09:01:45.260759+0000","last_undegraded":"2024-09-19T09:01:45.260759+0000","last_fullsized":"2024-09-19T09:01:45.260759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:40.122044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240013+0000","last_change":"2024-09-19T09:00:35.055349+0000","last_active":"2024-09-19T09:01:45.240013+0000","last_peered":"2024-09-19T09:01:45.240013+0000","last_clean":"2024-09-19T09:01:45.240013+0000","last_became_active":"2024-09-19T09:00:35.054406+0000","last_became_peered":"2024-09-19T09:00:35.054406+0000","last_unstale":"2024-09-19T09:01:45.240013+0000","last_undegraded":"2024-09-19T09:01:45.240013+0000","last_fullsized":"2024-09-19T09:01:45.240013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:01.640009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244968+0000","last_change":"2024-09-19T09:00:44.133083+0000","last_active":"2024-09-19T09:01:45.244968+0000","last_peered":"2024-09-19T09:01:45.244968+0000","last_clean":"2024-09-19T09:01:45.244968+0000","last_became_active":"2024-09-19T09:00:44.132661+0000","last_became_peered":"2024-09-19T09:00:44.132661+0000","last_unstale":"2024-09-19T09:01:45.244968+0000","last_undegraded":"2024-09-19T09:01:45.244968+0000","last_fullsized":"2024-09-19T09:01:45.244968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:24.272169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246701+0000","last_change":"2024-09-19T09:00:37.073915+0000","last_active":"2024-09-19T09:01:45.246701+0000","last_peered":"2024-09-19T09:01:45.246701+0000","last_clean":"2024-09-19T09:01:45.246701+0000","last_became_active":"2024-09-19T09:00:37.073560+0000","last_became_peered":"2024-09-19T09:00:37.073560+0000","last_unstale":"2024-09-19T09:01:45.246701+0000","last_undegraded":"2024-09-19T09:01:45.246701+0000","last_fullsized":"2024-09-19T09:01:45.246701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.989827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000042+0000","last_change":"2024-09-19T09:00:35.056260+0000","last_active":"2024-09-19T09:01:45.000042+0000","last_peered":"2024-09-19T09:01:45.000042+0000","last_clean":"2024-09-19T09:01:45.000042+0000","last_became_active":"2024-09-19T09:00:35.055862+0000","last_became_peered":"2024-09-19T09:00:35.055862+0000","last_unstale":"2024-09-19T09:01:45.000042+0000","last_undegraded":"2024-09-19T09:01:45.000042+0000","last_fullsized":"2024-09-19T09:01:45.000042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:12.642021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240194+0000","last_change":"2024-09-19T09:00:44.132934+0000","last_active":"2024-09-19T09:01:45.240194+0000","last_peered":"2024-09-19T09:01:45.240194+0000","last_clean":"2024-09-19T09:01:45.240194+0000","last_became_active":"2024-09-19T09:00:44.132417+0000","last_became_peered":"2024-09-19T09:00:44.132417+0000","last_unstale":"2024-09-19T09:01:45.240194+0000","last_undegraded":"2024-09-19T09:01:45.240194+0000","last_fullsized":"2024-09-19T09:01:45.240194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:19.363149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000300+0000","last_change":"2024-09-19T09:00:37.081436+0000","last_active":"2024-09-19T09:01:45.000300+0000","last_peered":"2024-09-19T09:01:45.000300+0000","last_clean":"2024-09-19T09:01:45.000300+0000","last_became_active":"2024-09-19T09:00:37.081114+0000","last_became_peered":"2024-09-19T09:00:37.081114+0000","last_unstale":"2024-09-19T09:01:45.000300+0000","last_undegraded":"2024-09-19T09:01:45.000300+0000","last_fullsized":"2024-09-19T09:01:45.000300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:54.360471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'34","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:04.274145+0000","last_change":"2024-09-19T09:00:35.056632+0000","last_active":"2024-09-19T09:02:04.274145+0000","last_peered":"2024-09-19T09:02:04.274145+0000","last_clean":"2024-09-19T09:02:04.274145+0000","last_became_active":"2024-09-19T09:00:35.055468+0000","last_became_peered":"2024-09-19T09:00:35.055468+0000","last_unstale":"2024-09-19T09:02:04.274145+0000","last_undegraded":"2024-09-19T09:02:04.274145+0000","last_fullsized":"2024-09-19T09:02:04.274145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:01.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62076,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998147+0000","last_change":"2024-09-19T09:00:44.128870+0000","last_active":"2024-09-19T09:01:44.998147+0000","last_peered":"2024-09-19T09:01:44.998147+0000","last_clean":"2024-09-19T09:01:44.998147+0000","last_became_active":"2024-09-19T09:00:44.128494+0000","last_became_peered":"2024-09-19T09:00:44.128494+0000","last_unstale":"2024-09-19T09:01:44.998147+0000","last_undegraded":"2024-09-19T09:01:44.998147+0000","last_fullsized":"2024-09-19T09:01:44.998147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:20.208407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000468+0000","last_change":"2024-09-19T09:00:37.086507+0000","last_active":"2024-09-19T09:01:45.000468+0000","last_peered":"2024-09-19T09:01:45.000468+0000","last_clean":"2024-09-19T09:01:45.000468+0000","last_became_active":"2024-09-19T09:00:37.086051+0000","last_became_peered":"2024-09-19T09:00:37.086051+0000","last_unstale":"2024-09-19T09:01:45.000468+0000","last_undegraded":"2024-09-19T09:01:45.000468+0000","last_fullsized":"2024-09-19T09:01:45.000468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:31.301804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240365+0000","last_change":"2024-09-19T09:00:35.501772+0000","last_active":"2024-09-19T09:01:45.240365+0000","last_peered":"2024-09-19T09:01:45.240365+0000","last_clean":"2024-09-19T09:01:45.240365+0000","last_became_active":"2024-09-19T09:00:35.501413+0000","last_became_peered":"2024-09-19T09:00:35.501413+0000","last_unstale":"2024-09-19T09:01:45.240365+0000","last_undegraded":"2024-09-19T09:01:45.240365+0000","last_fullsized":"2024-09-19T09:01:45.240365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:31.806234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.004063+0000","last_change":"2024-09-19T09:01:45.004063+0000","last_active":"2024-09-19T09:01:45.004063+0000","last_peered":"2024-09-19T09:01:45.004063+0000","last_clean":"2024-09-19T09:01:45.004063+0000","last_became_active":"2024-09-19T09:01:45.003631+0000","last_became_peered":"2024-09-19T09:01:45.003631+0000","last_unstale":"2024-09-19T09:01:45.004063+0000","last_undegraded":"2024-09-19T09:01:45.004063+0000","last_fullsized":"2024-09-19T09:01:45.004063+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:52.674340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245571+0000","last_change":"2024-09-19T09:00:37.078120+0000","last_active":"2024-09-19T09:01:45.245571+0000","last_peered":"2024-09-19T09:01:45.245571+0000","last_clean":"2024-09-19T09:01:45.245571+0000","last_became_active":"2024-09-19T09:00:37.077885+0000","last_became_peered":"2024-09-19T09:00:37.077885+0000","last_unstale":"2024-09-19T09:01:45.245571+0000","last_undegraded":"2024-09-19T09:01:45.245571+0000","last_fullsized":"2024-09-19T09:01:45.245571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:01.841615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260942+0000","last_change":"2024-09-19T09:00:35.059612+0000","last_active":"2024-09-19T09:01:45.260942+0000","last_peered":"2024-09-19T09:01:45.260942+0000","last_clean":"2024-09-19T09:01:45.260942+0000","last_became_active":"2024-09-19T09:00:35.059191+0000","last_became_peered":"2024-09-19T09:00:35.059191+0000","last_unstale":"2024-09-19T09:01:45.260942+0000","last_undegraded":"2024-09-19T09:01:45.260942+0000","last_fullsized":"2024-09-19T09:01:45.260942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:06.600073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246747+0000","last_change":"2024-09-19T09:01:45.246747+0000","last_active":"2024-09-19T09:01:45.246747+0000","last_peered":"2024-09-19T09:01:45.246747+0000","last_clean":"2024-09-19T09:01:45.246747+0000","last_became_active":"2024-09-19T09:01:45.246188+0000","last_became_peered":"2024-09-19T09:01:45.246188+0000","last_unstale":"2024-09-19T09:01:45.246747+0000","last_undegraded":"2024-09-19T09:01:45.246747+0000","last_fullsized":"2024-09-19T09:01:45.246747+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:02.319385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000213+0000","last_change":"2024-09-19T09:00:37.080025+0000","last_active":"2024-09-19T09:01:45.000213+0000","last_peered":"2024-09-19T09:01:45.000213+0000","last_clean":"2024-09-19T09:01:45.000213+0000","last_became_active":"2024-09-19T09:00:37.078012+0000","last_became_peered":"2024-09-19T09:00:37.078012+0000","last_unstale":"2024-09-19T09:01:45.000213+0000","last_undegraded":"2024-09-19T09:01:45.000213+0000","last_fullsized":"2024-09-19T09:01:45.000213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:25.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":138,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:04.253425+0000","last_change":"2024-09-19T09:00:35.059391+0000","last_active":"2024-09-19T09:02:04.253425+0000","last_peered":"2024-09-19T09:02:04.253425+0000","last_clean":"2024-09-19T09:02:04.253425+0000","last_became_active":"2024-09-19T09:00:35.059049+0000","last_became_peered":"2024-09-19T09:00:35.059049+0000","last_unstale":"2024-09-19T09:02:04.253425+0000","last_undegraded":"2024-09-19T09:02:04.253425+0000","last_fullsized":"2024-09-19T09:02:04.253425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:00.531411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245161+0000","last_change":"2024-09-19T09:00:44.133665+0000","last_active":"2024-09-19T09:01:45.245161+0000","last_peered":"2024-09-19T09:01:45.245161+0000","last_clean":"2024-09-19T09:01:45.245161+0000","last_became_active":"2024-09-19T09:00:44.133297+0000","last_became_peered":"2024-09-19T09:00:44.133297+0000","last_unstale":"2024-09-19T09:01:45.245161+0000","last_undegraded":"2024-09-19T09:01:45.245161+0000","last_fullsized":"2024-09-19T09:01:45.245161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:18.279936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245223+0000","last_change":"2024-09-19T09:00:44.136292+0000","last_active":"2024-09-19T09:01:45.245223+0000","last_peered":"2024-09-19T09:01:45.245223+0000","last_clean":"2024-09-19T09:01:45.245223+0000","last_became_active":"2024-09-19T09:00:44.135914+0000","last_became_peered":"2024-09-19T09:00:44.135914+0000","last_unstale":"2024-09-19T09:01:45.245223+0000","last_undegraded":"2024-09-19T09:01:45.245223+0000","last_fullsized":"2024-09-19T09:01:45.245223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:00.998217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998018+0000","last_change":"2024-09-19T09:00:37.066933+0000","last_active":"2024-09-19T09:01:44.998018+0000","last_peered":"2024-09-19T09:01:44.998018+0000","last_clean":"2024-09-19T09:01:44.998018+0000","last_became_active":"2024-09-19T09:00:37.066634+0000","last_became_peered":"2024-09-19T09:00:37.066634+0000","last_unstale":"2024-09-19T09:01:44.998018+0000","last_undegraded":"2024-09-19T09:01:44.998018+0000","last_fullsized":"2024-09-19T09:01:44.998018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239832+0000","last_change":"2024-09-19T09:00:35.057495+0000","last_active":"2024-09-19T09:01:45.239832+0000","last_peered":"2024-09-19T09:01:45.239832+0000","last_clean":"2024-09-19T09:01:45.239832+0000","last_became_active":"2024-09-19T09:00:35.057093+0000","last_became_peered":"2024-09-19T09:00:35.057093+0000","last_unstale":"2024-09-19T09:01:45.239832+0000","last_undegraded":"2024-09-19T09:01:45.239832+0000","last_fullsized":"2024-09-19T09:01:45.239832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:41.278464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245204+0000","last_change":"2024-09-19T09:00:44.135353+0000","last_active":"2024-09-19T09:01:45.245204+0000","last_peered":"2024-09-19T09:01:45.245204+0000","last_clean":"2024-09-19T09:01:45.245204+0000","last_became_active":"2024-09-19T09:00:44.134467+0000","last_became_peered":"2024-09-19T09:00:44.134467+0000","last_unstale":"2024-09-19T09:01:45.245204+0000","last_undegraded":"2024-09-19T09:01:45.245204+0000","last_fullsized":"2024-09-19T09:01:45.245204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:28.795561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246159+0000","last_change":"2024-09-19T09:00:37.067368+0000","last_active":"2024-09-19T09:01:45.246159+0000","last_peered":"2024-09-19T09:01:45.246159+0000","last_clean":"2024-09-19T09:01:45.246159+0000","last_became_active":"2024-09-19T09:00:37.067081+0000","last_became_peered":"2024-09-19T09:00:37.067081+0000","last_unstale":"2024-09-19T09:01:45.246159+0000","last_undegraded":"2024-09-19T09:01:45.246159+0000","last_fullsized":"2024-09-19T09:01:45.246159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:42.069148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245092+0000","last_change":"2024-09-19T09:00:35.052775+0000","last_active":"2024-09-19T09:01:45.245092+0000","last_peered":"2024-09-19T09:01:45.245092+0000","last_clean":"2024-09-19T09:01:45.245092+0000","last_became_active":"2024-09-19T09:00:35.052419+0000","last_became_peered":"2024-09-19T09:00:35.052419+0000","last_unstale":"2024-09-19T09:01:45.245092+0000","last_undegraded":"2024-09-19T09:01:45.245092+0000","last_fullsized":"2024-09-19T09:01:45.245092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:40.156076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999895+0000","last_change":"2024-09-19T09:00:35.055043+0000","last_active":"2024-09-19T09:01:44.999895+0000","last_peered":"2024-09-19T09:01:44.999895+0000","last_clean":"2024-09-19T09:01:44.999895+0000","last_became_active":"2024-09-19T09:00:35.054653+0000","last_became_peered":"2024-09-19T09:00:35.054653+0000","last_unstale":"2024-09-19T09:01:44.999895+0000","last_undegraded":"2024-09-19T09:01:44.999895+0000","last_fullsized":"2024-09-19T09:01:44.999895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.834239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240108+0000","last_change":"2024-09-19T09:00:37.077459+0000","last_active":"2024-09-19T09:01:45.240108+0000","last_peered":"2024-09-19T09:01:45.240108+0000","last_clean":"2024-09-19T09:01:45.240108+0000","last_became_active":"2024-09-19T09:00:37.077130+0000","last_became_peered":"2024-09-19T09:00:37.077130+0000","last_unstale":"2024-09-19T09:01:45.240108+0000","last_undegraded":"2024-09-19T09:01:45.240108+0000","last_fullsized":"2024-09-19T09:01:45.240108+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:36.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999807+0000","last_change":"2024-09-19T09:00:44.133996+0000","last_active":"2024-09-19T09:01:44.999807+0000","last_peered":"2024-09-19T09:01:44.999807+0000","last_clean":"2024-09-19T09:01:44.999807+0000","last_became_active":"2024-09-19T09:00:44.133628+0000","last_became_peered":"2024-09-19T09:00:44.133628+0000","last_unstale":"2024-09-19T09:01:44.999807+0000","last_undegraded":"2024-09-19T09:01:44.999807+0000","last_fullsized":"2024-09-19T09:01:44.999807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:50.332457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":93,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:05.269575+0000","last_change":"2024-09-19T09:00:35.053940+0000","last_active":"2024-09-19T09:02:05.269575+0000","last_peered":"2024-09-19T09:02:05.269575+0000","last_clean":"2024-09-19T09:02:05.269575+0000","last_became_active":"2024-09-19T09:00:35.053537+0000","last_became_peered":"2024-09-19T09:00:35.053537+0000","last_unstale":"2024-09-19T09:02:05.269575+0000","last_undegraded":"2024-09-19T09:02:05.269575+0000","last_fullsized":"2024-09-19T09:02:05.269575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:34.127981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000534+0000","last_change":"2024-09-19T09:00:37.080739+0000","last_active":"2024-09-19T09:01:45.000534+0000","last_peered":"2024-09-19T09:01:45.000534+0000","last_clean":"2024-09-19T09:01:45.000534+0000","last_became_active":"2024-09-19T09:00:37.077474+0000","last_became_peered":"2024-09-19T09:00:37.077474+0000","last_unstale":"2024-09-19T09:01:45.000534+0000","last_undegraded":"2024-09-19T09:01:45.000534+0000","last_fullsized":"2024-09-19T09:01:45.000534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:50.963793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000471+0000","last_change":"2024-09-19T09:00:44.136011+0000","last_active":"2024-09-19T09:01:45.000471+0000","last_peered":"2024-09-19T09:01:45.000471+0000","last_clean":"2024-09-19T09:01:45.000471+0000","last_became_active":"2024-09-19T09:00:44.135614+0000","last_became_peered":"2024-09-19T09:00:44.135614+0000","last_unstale":"2024-09-19T09:01:45.000471+0000","last_undegraded":"2024-09-19T09:01:45.000471+0000","last_fullsized":"2024-09-19T09:01:45.000471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:49.390677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244816+0000","last_change":"2024-09-19T09:00:37.081680+0000","last_active":"2024-09-19T09:01:45.244816+0000","last_peered":"2024-09-19T09:01:45.244816+0000","last_clean":"2024-09-19T09:01:45.244816+0000","last_became_active":"2024-09-19T09:00:37.081355+0000","last_became_peered":"2024-09-19T09:00:37.081355+0000","last_unstale":"2024-09-19T09:01:45.244816+0000","last_undegraded":"2024-09-19T09:01:45.244816+0000","last_fullsized":"2024-09-19T09:01:45.244816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:49.101880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999858+0000","last_change":"2024-09-19T09:00:37.076575+0000","last_active":"2024-09-19T09:01:44.999858+0000","last_peered":"2024-09-19T09:01:44.999858+0000","last_clean":"2024-09-19T09:01:44.999858+0000","last_became_active":"2024-09-19T09:00:37.076167+0000","last_became_peered":"2024-09-19T09:00:37.076167+0000","last_unstale":"2024-09-19T09:01:44.999858+0000","last_undegraded":"2024-09-19T09:01:44.999858+0000","last_fullsized":"2024-09-19T09:01:44.999858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:08.251308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999947+0000","last_change":"2024-09-19T09:00:37.080433+0000","last_active":"2024-09-19T09:01:44.999947+0000","last_peered":"2024-09-19T09:01:44.999947+0000","last_clean":"2024-09-19T09:01:44.999947+0000","last_became_active":"2024-09-19T09:00:37.074803+0000","last_became_peered":"2024-09-19T09:00:37.074803+0000","last_unstale":"2024-09-19T09:01:44.999947+0000","last_undegraded":"2024-09-19T09:01:44.999947+0000","last_fullsized":"2024-09-19T09:01:44.999947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:18.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245649+0000","last_change":"2024-09-19T09:00:37.073227+0000","last_active":"2024-09-19T09:01:45.245649+0000","last_peered":"2024-09-19T09:01:45.245649+0000","last_clean":"2024-09-19T09:01:45.245649+0000","last_became_active":"2024-09-19T09:00:37.072875+0000","last_became_peered":"2024-09-19T09:00:37.072875+0000","last_unstale":"2024-09-19T09:01:45.245649+0000","last_undegraded":"2024-09-19T09:01:45.245649+0000","last_fullsized":"2024-09-19T09:01:45.245649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:09.303029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246545+0000","last_change":"2024-09-19T09:00:37.077978+0000","last_active":"2024-09-19T09:01:45.246545+0000","last_peered":"2024-09-19T09:01:45.246545+0000","last_clean":"2024-09-19T09:01:45.246545+0000","last_became_active":"2024-09-19T09:00:37.077663+0000","last_became_peered":"2024-09-19T09:00:37.077663+0000","last_unstale":"2024-09-19T09:01:45.246545+0000","last_undegraded":"2024-09-19T09:01:45.246545+0000","last_fullsized":"2024-09-19T09:01:45.246545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:22.156471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245222+0000","last_change":"2024-09-19T09:00:37.086723+0000","last_active":"2024-09-19T09:01:45.245222+0000","last_peered":"2024-09-19T09:01:45.245222+0000","last_clean":"2024-09-19T09:01:45.245222+0000","last_became_active":"2024-09-19T09:00:37.086405+0000","last_became_peered":"2024-09-19T09:00:37.086405+0000","last_unstale":"2024-09-19T09:01:45.245222+0000","last_undegraded":"2024-09-19T09:01:45.245222+0000","last_fullsized":"2024-09-19T09:01:45.245222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:21.351964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000726+0000","last_change":"2024-09-19T09:00:37.083033+0000","last_active":"2024-09-19T09:01:45.000726+0000","last_peered":"2024-09-19T09:01:45.000726+0000","last_clean":"2024-09-19T09:01:45.000726+0000","last_became_active":"2024-09-19T09:00:37.082713+0000","last_became_peered":"2024-09-19T09:00:37.082713+0000","last_unstale":"2024-09-19T09:01:45.000726+0000","last_undegraded":"2024-09-19T09:01:45.000726+0000","last_fullsized":"2024-09-19T09:01:45.000726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:27.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245798+0000","last_change":"2024-09-19T09:00:37.076327+0000","last_active":"2024-09-19T09:01:45.245798+0000","last_peered":"2024-09-19T09:01:45.245798+0000","last_clean":"2024-09-19T09:01:45.245798+0000","last_became_active":"2024-09-19T09:00:37.076015+0000","last_became_peered":"2024-09-19T09:00:37.076015+0000","last_unstale":"2024-09-19T09:01:45.245798+0000","last_undegraded":"2024-09-19T09:01:45.245798+0000","last_fullsized":"2024-09-19T09:01:45.245798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.789995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239679+0000","last_change":"2024-09-19T09:00:37.076633+0000","last_active":"2024-09-19T09:01:45.239679+0000","last_peered":"2024-09-19T09:01:45.239679+0000","last_clean":"2024-09-19T09:01:45.239679+0000","last_became_active":"2024-09-19T09:00:37.075725+0000","last_became_peered":"2024-09-19T09:00:37.075725+0000","last_unstale":"2024-09-19T09:01:45.239679+0000","last_undegraded":"2024-09-19T09:01:45.239679+0000","last_fullsized":"2024-09-19T09:01:45.239679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:44.927819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245328+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:01:45.245328+0000","last_peered":"2024-09-19T09:01:45.245328+0000","last_clean":"2024-09-19T09:01:45.245328+0000","last_became_active":"2024-09-19T09:00:37.084998+0000","last_became_peered":"2024-09-19T09:00:37.084998+0000","last_unstale":"2024-09-19T09:01:45.245328+0000","last_undegraded":"2024-09-19T09:01:45.245328+0000","last_fullsized":"2024-09-19T09:01:45.245328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:57.316550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999945+0000","last_change":"2024-09-19T09:00:37.076500+0000","last_active":"2024-09-19T09:01:44.999945+0000","last_peered":"2024-09-19T09:01:44.999945+0000","last_clean":"2024-09-19T09:01:44.999945+0000","last_became_active":"2024-09-19T09:00:37.076135+0000","last_became_peered":"2024-09-19T09:00:37.076135+0000","last_unstale":"2024-09-19T09:01:44.999945+0000","last_undegraded":"2024-09-19T09:01:44.999945+0000","last_fullsized":"2024-09-19T09:01:44.999945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:06.726704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246571+0000","last_change":"2024-09-19T09:00:37.074370+0000","last_active":"2024-09-19T09:01:45.246571+0000","last_peered":"2024-09-19T09:01:45.246571+0000","last_clean":"2024-09-19T09:01:45.246571+0000","last_became_active":"2024-09-19T09:00:37.074076+0000","last_became_peered":"2024-09-19T09:00:37.074076+0000","last_unstale":"2024-09-19T09:01:45.246571+0000","last_undegraded":"2024-09-19T09:01:45.246571+0000","last_fullsized":"2024-09-19T09:01:45.246571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:56.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244989+0000","last_change":"2024-09-19T09:00:37.078887+0000","last_active":"2024-09-19T09:01:45.244989+0000","last_peered":"2024-09-19T09:01:45.244989+0000","last_clean":"2024-09-19T09:01:45.244989+0000","last_became_active":"2024-09-19T09:00:37.078192+0000","last_became_peered":"2024-09-19T09:00:37.078192+0000","last_unstale":"2024-09-19T09:01:45.244989+0000","last_undegraded":"2024-09-19T09:01:45.244989+0000","last_fullsized":"2024-09-19T09:01:45.244989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000652+0000","last_change":"2024-09-19T09:00:37.075932+0000","last_active":"2024-09-19T09:01:45.000652+0000","last_peered":"2024-09-19T09:01:45.000652+0000","last_clean":"2024-09-19T09:01:45.000652+0000","last_became_active":"2024-09-19T09:00:37.074637+0000","last_became_peered":"2024-09-19T09:00:37.074637+0000","last_unstale":"2024-09-19T09:01:45.000652+0000","last_undegraded":"2024-09-19T09:01:45.000652+0000","last_fullsized":"2024-09-19T09:01:45.000652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:27.423717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998386+0000","last_change":"2024-09-19T09:00:37.072804+0000","last_active":"2024-09-19T09:01:44.998386+0000","last_peered":"2024-09-19T09:01:44.998386+0000","last_clean":"2024-09-19T09:01:44.998386+0000","last_became_active":"2024-09-19T09:00:37.072500+0000","last_became_peered":"2024-09-19T09:00:37.072500+0000","last_unstale":"2024-09-19T09:01:44.998386+0000","last_undegraded":"2024-09-19T09:01:44.998386+0000","last_fullsized":"2024-09-19T09:01:44.998386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:56.035111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245383+0000","last_change":"2024-09-19T09:00:37.083195+0000","last_active":"2024-09-19T09:01:45.245383+0000","last_peered":"2024-09-19T09:01:45.245383+0000","last_clean":"2024-09-19T09:01:45.245383+0000","last_became_active":"2024-09-19T09:00:37.082332+0000","last_became_peered":"2024-09-19T09:00:37.082332+0000","last_unstale":"2024-09-19T09:01:45.245383+0000","last_undegraded":"2024-09-19T09:01:45.245383+0000","last_fullsized":"2024-09-19T09:01:45.245383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:12.802785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999403+0000","last_change":"2024-09-19T09:00:37.076955+0000","last_active":"2024-09-19T09:01:44.999403+0000","last_peered":"2024-09-19T09:01:44.999403+0000","last_clean":"2024-09-19T09:01:44.999403+0000","last_became_active":"2024-09-19T09:00:37.076637+0000","last_became_peered":"2024-09-19T09:00:37.076637+0000","last_unstale":"2024-09-19T09:01:44.999403+0000","last_undegraded":"2024-09-19T09:01:44.999403+0000","last_fullsized":"2024-09-19T09:01:44.999403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:51.181157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245160+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:01:45.245160+0000","last_peered":"2024-09-19T09:01:45.245160+0000","last_clean":"2024-09-19T09:01:45.245160+0000","last_became_active":"2024-09-19T09:00:37.084976+0000","last_became_peered":"2024-09-19T09:00:37.084976+0000","last_unstale":"2024-09-19T09:01:45.245160+0000","last_undegraded":"2024-09-19T09:01:45.245160+0000","last_fullsized":"2024-09-19T09:01:45.245160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:23.120946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245398+0000","last_change":"2024-09-19T09:00:37.082788+0000","last_active":"2024-09-19T09:01:45.245398+0000","last_peered":"2024-09-19T09:01:45.245398+0000","last_clean":"2024-09-19T09:01:45.245398+0000","last_became_active":"2024-09-19T09:00:37.082460+0000","last_became_peered":"2024-09-19T09:00:37.082460+0000","last_unstale":"2024-09-19T09:01:45.245398+0000","last_undegraded":"2024-09-19T09:01:45.245398+0000","last_fullsized":"2024-09-19T09:01:45.245398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:17.191671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246480+0000","last_change":"2024-09-19T09:00:37.075908+0000","last_active":"2024-09-19T09:01:45.246480+0000","last_peered":"2024-09-19T09:01:45.246480+0000","last_clean":"2024-09-19T09:01:45.246480+0000","last_became_active":"2024-09-19T09:00:37.075579+0000","last_became_peered":"2024-09-19T09:00:37.075579+0000","last_unstale":"2024-09-19T09:01:45.246480+0000","last_undegraded":"2024-09-19T09:01:45.246480+0000","last_fullsized":"2024-09-19T09:01:45.246480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:53.620585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001950+0000","last_change":"2024-09-19T09:00:37.084392+0000","last_active":"2024-09-19T09:01:45.001950+0000","last_peered":"2024-09-19T09:01:45.001950+0000","last_clean":"2024-09-19T09:01:45.001950+0000","last_became_active":"2024-09-19T09:00:37.084074+0000","last_became_peered":"2024-09-19T09:00:37.084074+0000","last_unstale":"2024-09-19T09:01:45.001950+0000","last_undegraded":"2024-09-19T09:01:45.001950+0000","last_fullsized":"2024-09-19T09:01:45.001950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:20.585494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260970+0000","last_change":"2024-09-19T09:00:37.084436+0000","last_active":"2024-09-19T09:01:45.260970+0000","last_peered":"2024-09-19T09:01:45.260970+0000","last_clean":"2024-09-19T09:01:45.260970+0000","last_became_active":"2024-09-19T09:00:37.083720+0000","last_became_peered":"2024-09-19T09:00:37.083720+0000","last_unstale":"2024-09-19T09:01:45.260970+0000","last_undegraded":"2024-09-19T09:01:45.260970+0000","last_fullsized":"2024-09-19T09:01:45.260970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.900914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000362+0000","last_change":"2024-09-19T09:00:37.080816+0000","last_active":"2024-09-19T09:01:45.000362+0000","last_peered":"2024-09-19T09:01:45.000362+0000","last_clean":"2024-09-19T09:01:45.000362+0000","last_became_active":"2024-09-19T09:00:37.080493+0000","last_became_peered":"2024-09-19T09:00:37.080493+0000","last_unstale":"2024-09-19T09:01:45.000362+0000","last_undegraded":"2024-09-19T09:01:45.000362+0000","last_fullsized":"2024-09-19T09:01:45.000362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:18.862965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000272+0000","last_change":"2024-09-19T09:00:37.079203+0000","last_active":"2024-09-19T09:01:45.000272+0000","last_peered":"2024-09-19T09:01:45.000272+0000","last_clean":"2024-09-19T09:01:45.000272+0000","last_became_active":"2024-09-19T09:00:37.078851+0000","last_became_peered":"2024-09-19T09:00:37.078851+0000","last_unstale":"2024-09-19T09:01:45.000272+0000","last_undegraded":"2024-09-19T09:01:45.000272+0000","last_fullsized":"2024-09-19T09:01:45.000272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:16.640023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246105+0000","last_change":"2024-09-19T09:00:37.077327+0000","last_active":"2024-09-19T09:01:45.246105+0000","last_peered":"2024-09-19T09:01:45.246105+0000","last_clean":"2024-09-19T09:01:45.246105+0000","last_became_active":"2024-09-19T09:00:37.077016+0000","last_became_peered":"2024-09-19T09:00:37.077016+0000","last_unstale":"2024-09-19T09:01:45.246105+0000","last_undegraded":"2024-09-19T09:01:45.246105+0000","last_fullsized":"2024-09-19T09:01:45.246105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:39.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260467+0000","last_change":"2024-09-19T09:00:37.081849+0000","last_active":"2024-09-19T09:01:45.260467+0000","last_peered":"2024-09-19T09:01:45.260467+0000","last_clean":"2024-09-19T09:01:45.260467+0000","last_became_active":"2024-09-19T09:00:37.081508+0000","last_became_peered":"2024-09-19T09:00:37.081508+0000","last_unstale":"2024-09-19T09:01:45.260467+0000","last_undegraded":"2024-09-19T09:01:45.260467+0000","last_fullsized":"2024-09-19T09:01:45.260467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:53.502987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999775+0000","last_change":"2024-09-19T09:00:37.074201+0000","last_active":"2024-09-19T09:01:44.999775+0000","last_peered":"2024-09-19T09:01:44.999775+0000","last_clean":"2024-09-19T09:01:44.999775+0000","last_became_active":"2024-09-19T09:00:37.073833+0000","last_became_peered":"2024-09-19T09:00:37.073833+0000","last_unstale":"2024-09-19T09:01:44.999775+0000","last_undegraded":"2024-09-19T09:01:44.999775+0000","last_fullsized":"2024-09-19T09:01:44.999775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:45.016566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000862+0000","last_change":"2024-09-19T09:00:37.078436+0000","last_active":"2024-09-19T09:01:45.000862+0000","last_peered":"2024-09-19T09:01:45.000862+0000","last_clean":"2024-09-19T09:01:45.000862+0000","last_became_active":"2024-09-19T09:00:37.077648+0000","last_became_peered":"2024-09-19T09:00:37.077648+0000","last_unstale":"2024-09-19T09:01:45.000862+0000","last_undegraded":"2024-09-19T09:01:45.000862+0000","last_fullsized":"2024-09-19T09:01:45.000862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.258856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998325+0000","last_change":"2024-09-19T09:00:44.131018+0000","last_active":"2024-09-19T09:01:44.998325+0000","last_peered":"2024-09-19T09:01:44.998325+0000","last_clean":"2024-09-19T09:01:44.998325+0000","last_became_active":"2024-09-19T09:00:44.130698+0000","last_became_peered":"2024-09-19T09:00:44.130698+0000","last_unstale":"2024-09-19T09:01:44.998325+0000","last_undegraded":"2024-09-19T09:01:44.998325+0000","last_fullsized":"2024-09-19T09:01:44.998325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:57.552728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245212+0000","last_change":"2024-09-19T09:00:37.085490+0000","last_active":"2024-09-19T09:01:45.245212+0000","last_peered":"2024-09-19T09:01:45.245212+0000","last_clean":"2024-09-19T09:01:45.245212+0000","last_became_active":"2024-09-19T09:00:37.085171+0000","last_became_peered":"2024-09-19T09:00:37.085171+0000","last_unstale":"2024-09-19T09:01:45.245212+0000","last_undegraded":"2024-09-19T09:01:45.245212+0000","last_fullsized":"2024-09-19T09:01:45.245212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:48.252031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245320+0000","last_change":"2024-09-19T09:00:37.071638+0000","last_active":"2024-09-19T09:01:45.245320+0000","last_peered":"2024-09-19T09:01:45.245320+0000","last_clean":"2024-09-19T09:01:45.245320+0000","last_became_active":"2024-09-19T09:00:37.071303+0000","last_became_peered":"2024-09-19T09:00:37.071303+0000","last_unstale":"2024-09-19T09:01:45.245320+0000","last_undegraded":"2024-09-19T09:01:45.245320+0000","last_fullsized":"2024-09-19T09:01:45.245320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:41.590831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245341+0000","last_change":"2024-09-19T09:00:37.083761+0000","last_active":"2024-09-19T09:01:45.245341+0000","last_peered":"2024-09-19T09:01:45.245341+0000","last_clean":"2024-09-19T09:01:45.245341+0000","last_became_active":"2024-09-19T09:00:37.079681+0000","last_became_peered":"2024-09-19T09:00:37.079681+0000","last_unstale":"2024-09-19T09:01:45.245341+0000","last_undegraded":"2024-09-19T09:01:45.245341+0000","last_fullsized":"2024-09-19T09:01:45.245341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:35.104720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69284,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":548,"num_read_kb":348,"num_write":248,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776165,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1716224,"data_stored":1155116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939689,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":509857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201327,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":506027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1642496,"data_stored":1103031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1024000,"data_stored":501658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36960,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708192,"statfs":{"total":95995035648,"available":95957188608,"internally_reserved":0,"allocated":1650688,"data_stored":1097827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1040384,"data_stored":506902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":500973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476814,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1101824,"data_stored":563421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1089536,"data_stored":564764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":502721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:02:10.469 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:02:10.713 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:11.115 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:11 smithi083 ceph-mon[30926]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:11.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 -- 172.21.15.83:0/1047970949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8106a80 msgr2=0x7fa0e8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1047970949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8106a80 0x7fa0e8106e60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009930 tx=0x7fa0d802a420 comp rx=0 tx=0).stop 2024-09-19T09:02:11.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 -- 172.21.15.83:0/1047970949 shutdown_connections 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1047970949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8101420 0x7fa0e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1047970949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0e8100a80 0x7fa0e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1047970949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8106a80 0x7fa0e8106e60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 -- 172.21.15.83:0/1047970949 >> 172.21.15.83:0/1047970949 conn(0x7fa0e80fc7a0 msgr2=0x7fa0e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 -- 172.21.15.83:0/1047970949 shutdown_connections 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.192+0000 7fa0eea06640 1 -- 172.21.15.83:0/1047970949 wait complete. 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 Processor -- start 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 -- start start 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 0x7fa0e8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0e8101420 0x7fa0e8197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8106a80 0x7fa0e819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8110d30 con 0x7fa0e8100a80 2024-09-19T09:02:11.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8110bb0 con 0x7fa0e8106a80 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.193+0000 7fa0eea06640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8110eb0 con 0x7fa0e8101420 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 0x7fa0e8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 0x7fa0e8197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46928/0 (socket says 172.21.15.83:46928) 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 -- 172.21.15.83:0/1652986533 learned_addr learned my addr 172.21.15.83:0/1652986533 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e77fe640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0e8101420 0x7fa0e8197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0ecfa3640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8106a80 0x7fa0e819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 -- 172.21.15.83:0/1652986533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0e8101420 msgr2=0x7fa0e8197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0e8101420 0x7fa0e8197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 -- 172.21.15.83:0/1652986533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8106a80 msgr2=0x7fa0e819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8106a80 0x7fa0e819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 -- 172.21.15.83:0/1652986533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e819c2e0 con 0x7fa0e8100a80 2024-09-19T09:02:11.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0ecfa3640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8106a80 0x7fa0e819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e7fff640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 0x7fa0e8197330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005940 tx=0x7fa0d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d803f030 con 0x7fa0e8100a80 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e819c570 con 0x7fa0e8100a80 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0d8003cb0 con 0x7fa0e8100a80 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8035070 con 0x7fa0e8100a80 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.194+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e81a3eb0 con 0x7fa0e8100a80 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.195+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e81021c0 con 0x7fa0e8100a80 2024-09-19T09:02:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.197+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa0d8042030 con 0x7fa0e8100a80 2024-09-19T09:02:11.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.198+0000 7fa0e57fa640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa0d00a32d0 0x7fa0d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:11.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.198+0000 7fa0e77fe640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa0d00a32d0 0x7fa0d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:11.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.198+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa0d80f0680 con 0x7fa0e8100a80 2024-09-19T09:02:11.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.198+0000 7fa0e77fe640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa0d00a32d0 0x7fa0d00a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005fd0 tx=0x7fa0dc005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:11.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.201+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0d80bcee0 con 0x7fa0e8100a80 2024-09-19T09:02:11.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.366+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0e8109060 con 0x7fa0d00a32d0 2024-09-19T09:02:11.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.374+0000 7fa0e57fa640 1 -- 172.21.15.83:0/1652986533 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340413 (secure 0 0 0) 0x7fa0dc00ea00 con 0x7fa0d00a32d0 2024-09-19T09:02:11.380 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:11.382 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa0d00a32d0 msgr2=0x7fa0d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa0d00a32d0 0x7fa0d00a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005fd0 tx=0x7fa0dc005e20 comp rx=0 tx=0).stop 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 msgr2=0x7fa0e8197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 0x7fa0e8197330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005940 tx=0x7fa0d80042f0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 shutdown_connections 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa0d00a32d0 0x7fa0d00a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0e8106a80 0x7fa0e819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0e8101420 0x7fa0e8197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 --2- 172.21.15.83:0/1652986533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e8100a80 0x7fa0e8197330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 >> 172.21.15.83:0/1652986533 conn(0x7fa0e80fc7a0 msgr2=0x7fa0e80fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:11.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 shutdown_connections 2024-09-19T09:02:11.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:11.378+0000 7fa0eea06640 1 -- 172.21.15.83:0/1652986533 wait complete. 2024-09-19T09:02:11.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:11 smithi184 ceph-mon[35007]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:11.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:11 smithi122 ceph-mon[34247]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:12.124 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-19T09:02:10.936176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659886,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":714,"num_read_kb":487,"num_write":431,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380088,"kb_used_data":14132,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561736,"statfs":{"total":1151940427776,"available":1151551217664,"internally_reserved":0,"allocated":14471168,"data_stored":8018240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":374453563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003420"},"pg_stats":[{"pgid":"2.1f","version":"87'13","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:07.289007+0000","last_change":"2024-09-19T09:00:35.055195+0000","last_active":"2024-09-19T09:02:07.289007+0000","last_peered":"2024-09-19T09:02:07.289007+0000","last_clean":"2024-09-19T09:02:07.289007+0000","last_became_active":"2024-09-19T09:00:35.054878+0000","last_became_peered":"2024-09-19T09:00:35.054878+0000","last_unstale":"2024-09-19T09:02:07.289007+0000","last_undegraded":"2024-09-19T09:02:07.289007+0000","last_fullsized":"2024-09-19T09:02:07.289007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:40.719595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246079+0000","last_change":"2024-09-19T09:00:37.077470+0000","last_active":"2024-09-19T09:01:45.246079+0000","last_peered":"2024-09-19T09:01:45.246079+0000","last_clean":"2024-09-19T09:01:45.246079+0000","last_became_active":"2024-09-19T09:00:37.077158+0000","last_became_peered":"2024-09-19T09:00:37.077158+0000","last_unstale":"2024-09-19T09:01:45.246079+0000","last_undegraded":"2024-09-19T09:01:45.246079+0000","last_fullsized":"2024-09-19T09:01:45.246079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:00.350496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999600+0000","last_change":"2024-09-19T09:00:44.135294+0000","last_active":"2024-09-19T09:01:44.999600+0000","last_peered":"2024-09-19T09:01:44.999600+0000","last_clean":"2024-09-19T09:01:44.999600+0000","last_became_active":"2024-09-19T09:00:44.134844+0000","last_became_peered":"2024-09-19T09:00:44.134844+0000","last_unstale":"2024-09-19T09:01:44.999600+0000","last_undegraded":"2024-09-19T09:01:44.999600+0000","last_fullsized":"2024-09-19T09:01:44.999600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:06.231954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246287+0000","last_change":"2024-09-19T09:00:35.499941+0000","last_active":"2024-09-19T09:01:45.246287+0000","last_peered":"2024-09-19T09:01:45.246287+0000","last_clean":"2024-09-19T09:01:45.246287+0000","last_became_active":"2024-09-19T09:00:35.499463+0000","last_became_peered":"2024-09-19T09:00:35.499463+0000","last_unstale":"2024-09-19T09:01:45.246287+0000","last_undegraded":"2024-09-19T09:01:45.246287+0000","last_fullsized":"2024-09-19T09:01:45.246287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:15.603127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245413+0000","last_change":"2024-09-19T09:00:37.078318+0000","last_active":"2024-09-19T09:01:45.245413+0000","last_peered":"2024-09-19T09:01:45.245413+0000","last_clean":"2024-09-19T09:01:45.245413+0000","last_became_active":"2024-09-19T09:00:37.078037+0000","last_became_peered":"2024-09-19T09:00:37.078037+0000","last_unstale":"2024-09-19T09:01:45.245413+0000","last_undegraded":"2024-09-19T09:01:45.245413+0000","last_fullsized":"2024-09-19T09:01:45.245413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:41.860274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001581+0000","last_change":"2024-09-19T09:00:44.132012+0000","last_active":"2024-09-19T09:01:45.001581+0000","last_peered":"2024-09-19T09:01:45.001581+0000","last_clean":"2024-09-19T09:01:45.001581+0000","last_became_active":"2024-09-19T09:00:44.131238+0000","last_became_peered":"2024-09-19T09:00:44.131238+0000","last_unstale":"2024-09-19T09:01:45.001581+0000","last_undegraded":"2024-09-19T09:01:45.001581+0000","last_fullsized":"2024-09-19T09:01:45.001581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:07.931510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000500+0000","last_change":"2024-09-19T09:00:35.059882+0000","last_active":"2024-09-19T09:01:45.000500+0000","last_peered":"2024-09-19T09:01:45.000500+0000","last_clean":"2024-09-19T09:01:45.000500+0000","last_became_active":"2024-09-19T09:00:35.059467+0000","last_became_peered":"2024-09-19T09:00:35.059467+0000","last_unstale":"2024-09-19T09:01:45.000500+0000","last_undegraded":"2024-09-19T09:01:45.000500+0000","last_fullsized":"2024-09-19T09:01:45.000500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:59.309282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000047+0000","last_change":"2024-09-19T09:00:37.078097+0000","last_active":"2024-09-19T09:01:45.000047+0000","last_peered":"2024-09-19T09:01:45.000047+0000","last_clean":"2024-09-19T09:01:45.000047+0000","last_became_active":"2024-09-19T09:00:37.077770+0000","last_became_peered":"2024-09-19T09:00:37.077770+0000","last_unstale":"2024-09-19T09:01:45.000047+0000","last_undegraded":"2024-09-19T09:01:45.000047+0000","last_fullsized":"2024-09-19T09:01:45.000047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:57.045406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002075+0000","last_change":"2024-09-19T09:00:44.128702+0000","last_active":"2024-09-19T09:01:45.002075+0000","last_peered":"2024-09-19T09:01:45.002075+0000","last_clean":"2024-09-19T09:01:45.002075+0000","last_became_active":"2024-09-19T09:00:44.128324+0000","last_became_peered":"2024-09-19T09:00:44.128324+0000","last_unstale":"2024-09-19T09:01:45.002075+0000","last_undegraded":"2024-09-19T09:01:45.002075+0000","last_fullsized":"2024-09-19T09:01:45.002075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:43.165912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001454+0000","last_change":"2024-09-19T09:00:35.057840+0000","last_active":"2024-09-19T09:01:45.001454+0000","last_peered":"2024-09-19T09:01:45.001454+0000","last_clean":"2024-09-19T09:01:45.001454+0000","last_became_active":"2024-09-19T09:00:35.057458+0000","last_became_peered":"2024-09-19T09:00:35.057458+0000","last_unstale":"2024-09-19T09:01:45.001454+0000","last_undegraded":"2024-09-19T09:01:45.001454+0000","last_fullsized":"2024-09-19T09:01:45.001454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:40.393892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240203+0000","last_change":"2024-09-19T09:00:37.082885+0000","last_active":"2024-09-19T09:01:45.240203+0000","last_peered":"2024-09-19T09:01:45.240203+0000","last_clean":"2024-09-19T09:01:45.240203+0000","last_became_active":"2024-09-19T09:00:37.082494+0000","last_became_peered":"2024-09-19T09:00:37.082494+0000","last_unstale":"2024-09-19T09:01:45.240203+0000","last_undegraded":"2024-09-19T09:01:45.240203+0000","last_fullsized":"2024-09-19T09:01:45.240203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:47.795093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.247623+0000","last_change":"2024-09-19T09:01:45.247623+0000","last_active":"2024-09-19T09:01:45.247623+0000","last_peered":"2024-09-19T09:01:45.247623+0000","last_clean":"2024-09-19T09:01:45.247623+0000","last_became_active":"2024-09-19T09:01:45.247195+0000","last_became_peered":"2024-09-19T09:01:45.247195+0000","last_unstale":"2024-09-19T09:01:45.247623+0000","last_undegraded":"2024-09-19T09:01:45.247623+0000","last_fullsized":"2024-09-19T09:01:45.247623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:03.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260493+0000","last_change":"2024-09-19T09:00:37.079297+0000","last_active":"2024-09-19T09:01:45.260493+0000","last_peered":"2024-09-19T09:01:45.260493+0000","last_clean":"2024-09-19T09:01:45.260493+0000","last_became_active":"2024-09-19T09:00:37.078949+0000","last_became_peered":"2024-09-19T09:00:37.078949+0000","last_unstale":"2024-09-19T09:01:45.260493+0000","last_undegraded":"2024-09-19T09:01:45.260493+0000","last_fullsized":"2024-09-19T09:01:45.260493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:33.823014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000977+0000","last_change":"2024-09-19T09:00:35.058467+0000","last_active":"2024-09-19T09:01:45.000977+0000","last_peered":"2024-09-19T09:01:45.000977+0000","last_clean":"2024-09-19T09:01:45.000977+0000","last_became_active":"2024-09-19T09:00:35.058103+0000","last_became_peered":"2024-09-19T09:00:35.058103+0000","last_unstale":"2024-09-19T09:01:45.000977+0000","last_undegraded":"2024-09-19T09:01:45.000977+0000","last_fullsized":"2024-09-19T09:01:45.000977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:29.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002279+0000","last_change":"2024-09-19T09:00:44.129381+0000","last_active":"2024-09-19T09:01:45.002279+0000","last_peered":"2024-09-19T09:01:45.002279+0000","last_clean":"2024-09-19T09:01:45.002279+0000","last_became_active":"2024-09-19T09:00:44.128984+0000","last_became_peered":"2024-09-19T09:00:44.128984+0000","last_unstale":"2024-09-19T09:01:45.002279+0000","last_undegraded":"2024-09-19T09:01:45.002279+0000","last_fullsized":"2024-09-19T09:01:45.002279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:28.427607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245648+0000","last_change":"2024-09-19T09:00:37.066684+0000","last_active":"2024-09-19T09:01:45.245648+0000","last_peered":"2024-09-19T09:01:45.245648+0000","last_clean":"2024-09-19T09:01:45.245648+0000","last_became_active":"2024-09-19T09:00:37.066401+0000","last_became_peered":"2024-09-19T09:00:37.066401+0000","last_unstale":"2024-09-19T09:01:45.245648+0000","last_undegraded":"2024-09-19T09:01:45.245648+0000","last_fullsized":"2024-09-19T09:01:45.245648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:54.344499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244830+0000","last_change":"2024-09-19T09:00:44.123394+0000","last_active":"2024-09-19T09:01:45.244830+0000","last_peered":"2024-09-19T09:01:45.244830+0000","last_clean":"2024-09-19T09:01:45.244830+0000","last_became_active":"2024-09-19T09:00:44.122905+0000","last_became_peered":"2024-09-19T09:00:44.122905+0000","last_unstale":"2024-09-19T09:01:45.244830+0000","last_undegraded":"2024-09-19T09:01:45.244830+0000","last_fullsized":"2024-09-19T09:01:45.244830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.852333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001579+0000","last_change":"2024-09-19T09:00:44.134493+0000","last_active":"2024-09-19T09:01:45.001579+0000","last_peered":"2024-09-19T09:01:45.001579+0000","last_clean":"2024-09-19T09:01:45.001579+0000","last_became_active":"2024-09-19T09:00:44.133991+0000","last_became_peered":"2024-09-19T09:00:44.133991+0000","last_unstale":"2024-09-19T09:01:45.001579+0000","last_undegraded":"2024-09-19T09:01:45.001579+0000","last_fullsized":"2024-09-19T09:01:45.001579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:08.981672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244850+0000","last_change":"2024-09-19T09:00:37.077400+0000","last_active":"2024-09-19T09:01:45.244850+0000","last_peered":"2024-09-19T09:01:45.244850+0000","last_clean":"2024-09-19T09:01:45.244850+0000","last_became_active":"2024-09-19T09:00:37.077065+0000","last_became_peered":"2024-09-19T09:00:37.077065+0000","last_unstale":"2024-09-19T09:01:45.244850+0000","last_undegraded":"2024-09-19T09:01:45.244850+0000","last_fullsized":"2024-09-19T09:01:45.244850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:59.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245481+0000","last_change":"2024-09-19T09:00:35.053074+0000","last_active":"2024-09-19T09:01:45.245481+0000","last_peered":"2024-09-19T09:01:45.245481+0000","last_clean":"2024-09-19T09:01:45.245481+0000","last_became_active":"2024-09-19T09:00:35.052574+0000","last_became_peered":"2024-09-19T09:00:35.052574+0000","last_unstale":"2024-09-19T09:01:45.245481+0000","last_undegraded":"2024-09-19T09:01:45.245481+0000","last_fullsized":"2024-09-19T09:01:45.245481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:25.762622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998374+0000","last_change":"2024-09-19T09:00:44.132931+0000","last_active":"2024-09-19T09:01:44.998374+0000","last_peered":"2024-09-19T09:01:44.998374+0000","last_clean":"2024-09-19T09:01:44.998374+0000","last_became_active":"2024-09-19T09:00:44.132397+0000","last_became_peered":"2024-09-19T09:00:44.132397+0000","last_unstale":"2024-09-19T09:01:44.998374+0000","last_undegraded":"2024-09-19T09:01:44.998374+0000","last_fullsized":"2024-09-19T09:01:44.998374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.962417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000249+0000","last_change":"2024-09-19T09:00:37.077233+0000","last_active":"2024-09-19T09:01:45.000249+0000","last_peered":"2024-09-19T09:01:45.000249+0000","last_clean":"2024-09-19T09:01:45.000249+0000","last_became_active":"2024-09-19T09:00:37.076855+0000","last_became_peered":"2024-09-19T09:00:37.076855+0000","last_unstale":"2024-09-19T09:01:45.000249+0000","last_undegraded":"2024-09-19T09:01:45.000249+0000","last_fullsized":"2024-09-19T09:01:45.000249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:32.794488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999721+0000","last_change":"2024-09-19T09:00:35.501157+0000","last_active":"2024-09-19T09:01:44.999721+0000","last_peered":"2024-09-19T09:01:44.999721+0000","last_clean":"2024-09-19T09:01:44.999721+0000","last_became_active":"2024-09-19T09:00:35.500869+0000","last_became_peered":"2024-09-19T09:00:35.500869+0000","last_unstale":"2024-09-19T09:01:44.999721+0000","last_undegraded":"2024-09-19T09:01:44.999721+0000","last_fullsized":"2024-09-19T09:01:44.999721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:44.333496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001420+0000","last_change":"2024-09-19T09:00:44.131479+0000","last_active":"2024-09-19T09:01:45.001420+0000","last_peered":"2024-09-19T09:01:45.001420+0000","last_clean":"2024-09-19T09:01:45.001420+0000","last_became_active":"2024-09-19T09:00:44.131058+0000","last_became_peered":"2024-09-19T09:00:44.131058+0000","last_unstale":"2024-09-19T09:01:45.001420+0000","last_undegraded":"2024-09-19T09:01:45.001420+0000","last_fullsized":"2024-09-19T09:01:45.001420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.980874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245413+0000","last_change":"2024-09-19T09:00:37.076590+0000","last_active":"2024-09-19T09:01:45.245413+0000","last_peered":"2024-09-19T09:01:45.245413+0000","last_clean":"2024-09-19T09:01:45.245413+0000","last_became_active":"2024-09-19T09:00:37.076287+0000","last_became_peered":"2024-09-19T09:00:37.076287+0000","last_unstale":"2024-09-19T09:01:45.245413+0000","last_undegraded":"2024-09-19T09:01:45.245413+0000","last_fullsized":"2024-09-19T09:01:45.245413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:22.237571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002908+0000","last_change":"2024-09-19T09:00:35.733174+0000","last_active":"2024-09-19T09:01:45.002908+0000","last_peered":"2024-09-19T09:01:45.002908+0000","last_clean":"2024-09-19T09:01:45.002908+0000","last_became_active":"2024-09-19T09:00:35.732824+0000","last_became_peered":"2024-09-19T09:00:35.732824+0000","last_unstale":"2024-09-19T09:01:45.002908+0000","last_undegraded":"2024-09-19T09:01:45.002908+0000","last_fullsized":"2024-09-19T09:01:45.002908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:15.143792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999629+0000","last_change":"2024-09-19T09:00:44.137095+0000","last_active":"2024-09-19T09:01:44.999629+0000","last_peered":"2024-09-19T09:01:44.999629+0000","last_clean":"2024-09-19T09:01:44.999629+0000","last_became_active":"2024-09-19T09:00:44.136697+0000","last_became_peered":"2024-09-19T09:00:44.136697+0000","last_unstale":"2024-09-19T09:01:44.999629+0000","last_undegraded":"2024-09-19T09:01:44.999629+0000","last_fullsized":"2024-09-19T09:01:44.999629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:14.316016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245873+0000","last_change":"2024-09-19T09:00:37.074155+0000","last_active":"2024-09-19T09:01:45.245873+0000","last_peered":"2024-09-19T09:01:45.245873+0000","last_clean":"2024-09-19T09:01:45.245873+0000","last_became_active":"2024-09-19T09:00:37.073819+0000","last_became_peered":"2024-09-19T09:00:37.073819+0000","last_unstale":"2024-09-19T09:01:45.245873+0000","last_undegraded":"2024-09-19T09:01:45.245873+0000","last_fullsized":"2024-09-19T09:01:45.245873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:18.598437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998396+0000","last_change":"2024-09-19T09:00:35.055231+0000","last_active":"2024-09-19T09:01:44.998396+0000","last_peered":"2024-09-19T09:01:44.998396+0000","last_clean":"2024-09-19T09:01:44.998396+0000","last_became_active":"2024-09-19T09:00:35.054915+0000","last_became_peered":"2024-09-19T09:00:35.054915+0000","last_unstale":"2024-09-19T09:01:44.998396+0000","last_undegraded":"2024-09-19T09:01:44.998396+0000","last_fullsized":"2024-09-19T09:01:44.998396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:27.730738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245985+0000","last_change":"2024-09-19T09:00:44.134600+0000","last_active":"2024-09-19T09:01:45.245985+0000","last_peered":"2024-09-19T09:01:45.245985+0000","last_clean":"2024-09-19T09:01:45.245985+0000","last_became_active":"2024-09-19T09:00:44.134274+0000","last_became_peered":"2024-09-19T09:00:44.134274+0000","last_unstale":"2024-09-19T09:01:45.245985+0000","last_undegraded":"2024-09-19T09:01:45.245985+0000","last_fullsized":"2024-09-19T09:01:45.245985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:07.172654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246635+0000","last_change":"2024-09-19T09:00:37.075695+0000","last_active":"2024-09-19T09:01:45.246635+0000","last_peered":"2024-09-19T09:01:45.246635+0000","last_clean":"2024-09-19T09:01:45.246635+0000","last_became_active":"2024-09-19T09:00:37.075395+0000","last_became_peered":"2024-09-19T09:00:37.075395+0000","last_unstale":"2024-09-19T09:01:45.246635+0000","last_undegraded":"2024-09-19T09:01:45.246635+0000","last_fullsized":"2024-09-19T09:01:45.246635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.105953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000636+0000","last_change":"2024-09-19T09:00:35.502029+0000","last_active":"2024-09-19T09:01:45.000636+0000","last_peered":"2024-09-19T09:01:45.000636+0000","last_clean":"2024-09-19T09:01:45.000636+0000","last_became_active":"2024-09-19T09:00:35.501535+0000","last_became_peered":"2024-09-19T09:00:35.501535+0000","last_unstale":"2024-09-19T09:01:45.000636+0000","last_undegraded":"2024-09-19T09:01:45.000636+0000","last_fullsized":"2024-09-19T09:01:45.000636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:12.104470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244860+0000","last_change":"2024-09-19T09:00:44.134361+0000","last_active":"2024-09-19T09:01:45.244860+0000","last_peered":"2024-09-19T09:01:45.244860+0000","last_clean":"2024-09-19T09:01:45.244860+0000","last_became_active":"2024-09-19T09:00:44.133859+0000","last_became_peered":"2024-09-19T09:00:44.133859+0000","last_unstale":"2024-09-19T09:01:45.244860+0000","last_undegraded":"2024-09-19T09:01:45.244860+0000","last_fullsized":"2024-09-19T09:01:45.244860+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:29.075555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999646+0000","last_change":"2024-09-19T09:00:37.067259+0000","last_active":"2024-09-19T09:01:44.999646+0000","last_peered":"2024-09-19T09:01:44.999646+0000","last_clean":"2024-09-19T09:01:44.999646+0000","last_became_active":"2024-09-19T09:00:37.066932+0000","last_became_peered":"2024-09-19T09:00:37.066932+0000","last_unstale":"2024-09-19T09:01:44.999646+0000","last_undegraded":"2024-09-19T09:01:44.999646+0000","last_fullsized":"2024-09-19T09:01:44.999646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:09.205551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998439+0000","last_change":"2024-09-19T09:00:35.501139+0000","last_active":"2024-09-19T09:01:44.998439+0000","last_peered":"2024-09-19T09:01:44.998439+0000","last_clean":"2024-09-19T09:01:44.998439+0000","last_became_active":"2024-09-19T09:00:35.500790+0000","last_became_peered":"2024-09-19T09:00:35.500790+0000","last_unstale":"2024-09-19T09:01:44.998439+0000","last_undegraded":"2024-09-19T09:01:44.998439+0000","last_fullsized":"2024-09-19T09:01:44.998439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:51.811772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000368+0000","last_change":"2024-09-19T09:00:44.130524+0000","last_active":"2024-09-19T09:01:45.000368+0000","last_peered":"2024-09-19T09:01:45.000368+0000","last_clean":"2024-09-19T09:01:45.000368+0000","last_became_active":"2024-09-19T09:00:44.130002+0000","last_became_peered":"2024-09-19T09:00:44.130002+0000","last_unstale":"2024-09-19T09:01:45.000368+0000","last_undegraded":"2024-09-19T09:01:45.000368+0000","last_fullsized":"2024-09-19T09:01:45.000368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:35.060388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999904+0000","last_change":"2024-09-19T09:00:44.128716+0000","last_active":"2024-09-19T09:01:44.999904+0000","last_peered":"2024-09-19T09:01:44.999904+0000","last_clean":"2024-09-19T09:01:44.999904+0000","last_became_active":"2024-09-19T09:00:44.128295+0000","last_became_peered":"2024-09-19T09:00:44.128295+0000","last_unstale":"2024-09-19T09:01:44.999904+0000","last_undegraded":"2024-09-19T09:01:44.999904+0000","last_fullsized":"2024-09-19T09:01:44.999904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:55.576207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:07.289509+0000","last_change":"2024-09-19T09:00:35.057111+0000","last_active":"2024-09-19T09:02:07.289509+0000","last_peered":"2024-09-19T09:02:07.289509+0000","last_clean":"2024-09-19T09:02:07.289509+0000","last_became_active":"2024-09-19T09:00:35.056761+0000","last_became_peered":"2024-09-19T09:00:35.056761+0000","last_unstale":"2024-09-19T09:02:07.289509+0000","last_undegraded":"2024-09-19T09:02:07.289509+0000","last_fullsized":"2024-09-19T09:02:07.289509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:22.222798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246391+0000","last_change":"2024-09-19T09:00:44.130871+0000","last_active":"2024-09-19T09:01:45.246391+0000","last_peered":"2024-09-19T09:01:45.246391+0000","last_clean":"2024-09-19T09:01:45.246391+0000","last_became_active":"2024-09-19T09:00:44.130481+0000","last_became_peered":"2024-09-19T09:00:44.130481+0000","last_unstale":"2024-09-19T09:01:45.246391+0000","last_undegraded":"2024-09-19T09:01:45.246391+0000","last_fullsized":"2024-09-19T09:01:45.246391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:47.312776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239699+0000","last_change":"2024-09-19T09:00:37.077325+0000","last_active":"2024-09-19T09:01:45.239699+0000","last_peered":"2024-09-19T09:01:45.239699+0000","last_clean":"2024-09-19T09:01:45.239699+0000","last_became_active":"2024-09-19T09:00:37.076979+0000","last_became_peered":"2024-09-19T09:00:37.076979+0000","last_unstale":"2024-09-19T09:01:45.239699+0000","last_undegraded":"2024-09-19T09:01:45.239699+0000","last_fullsized":"2024-09-19T09:01:45.239699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:25.367304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":93,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:06.277218+0000","last_change":"2024-09-19T09:00:35.499862+0000","last_active":"2024-09-19T09:02:06.277218+0000","last_peered":"2024-09-19T09:02:06.277218+0000","last_clean":"2024-09-19T09:02:06.277218+0000","last_became_active":"2024-09-19T09:00:35.499534+0000","last_became_peered":"2024-09-19T09:00:35.499534+0000","last_unstale":"2024-09-19T09:02:06.277218+0000","last_undegraded":"2024-09-19T09:02:06.277218+0000","last_fullsized":"2024-09-19T09:02:06.277218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:21.008440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246296+0000","last_change":"2024-09-19T09:00:44.135298+0000","last_active":"2024-09-19T09:01:45.246296+0000","last_peered":"2024-09-19T09:01:45.246296+0000","last_clean":"2024-09-19T09:01:45.246296+0000","last_became_active":"2024-09-19T09:00:44.134899+0000","last_became_peered":"2024-09-19T09:00:44.134899+0000","last_unstale":"2024-09-19T09:01:45.246296+0000","last_undegraded":"2024-09-19T09:01:45.246296+0000","last_fullsized":"2024-09-19T09:01:45.246296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.741661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244984+0000","last_change":"2024-09-19T09:00:37.076195+0000","last_active":"2024-09-19T09:01:45.244984+0000","last_peered":"2024-09-19T09:01:45.244984+0000","last_clean":"2024-09-19T09:01:45.244984+0000","last_became_active":"2024-09-19T09:00:37.075906+0000","last_became_peered":"2024-09-19T09:00:37.075906+0000","last_unstale":"2024-09-19T09:01:45.244984+0000","last_undegraded":"2024-09-19T09:01:45.244984+0000","last_fullsized":"2024-09-19T09:01:45.244984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:47.724434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260427+0000","last_change":"2024-09-19T09:00:35.059862+0000","last_active":"2024-09-19T09:01:45.260427+0000","last_peered":"2024-09-19T09:01:45.260427+0000","last_clean":"2024-09-19T09:01:45.260427+0000","last_became_active":"2024-09-19T09:00:35.058944+0000","last_became_peered":"2024-09-19T09:00:35.058944+0000","last_unstale":"2024-09-19T09:01:45.260427+0000","last_undegraded":"2024-09-19T09:01:45.260427+0000","last_fullsized":"2024-09-19T09:01:45.260427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:00.233367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240289+0000","last_change":"2024-09-19T09:00:44.133451+0000","last_active":"2024-09-19T09:01:45.240289+0000","last_peered":"2024-09-19T09:01:45.240289+0000","last_clean":"2024-09-19T09:01:45.240289+0000","last_became_active":"2024-09-19T09:00:44.133069+0000","last_became_peered":"2024-09-19T09:00:44.133069+0000","last_unstale":"2024-09-19T09:01:45.240289+0000","last_undegraded":"2024-09-19T09:01:45.240289+0000","last_fullsized":"2024-09-19T09:01:45.240289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:22.890861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998053+0000","last_change":"2024-09-19T09:00:44.132394+0000","last_active":"2024-09-19T09:01:44.998053+0000","last_peered":"2024-09-19T09:01:44.998053+0000","last_clean":"2024-09-19T09:01:44.998053+0000","last_became_active":"2024-09-19T09:00:44.132050+0000","last_became_peered":"2024-09-19T09:00:44.132050+0000","last_unstale":"2024-09-19T09:01:44.998053+0000","last_undegraded":"2024-09-19T09:01:44.998053+0000","last_fullsized":"2024-09-19T09:01:44.998053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:12.963885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.002241+0000","last_change":"2024-09-19T09:00:35.055179+0000","last_active":"2024-09-19T09:01:45.002241+0000","last_peered":"2024-09-19T09:01:45.002241+0000","last_clean":"2024-09-19T09:01:45.002241+0000","last_became_active":"2024-09-19T09:00:35.054788+0000","last_became_peered":"2024-09-19T09:00:35.054788+0000","last_unstale":"2024-09-19T09:01:45.002241+0000","last_undegraded":"2024-09-19T09:01:45.002241+0000","last_fullsized":"2024-09-19T09:01:45.002241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:50.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":360,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260631+0000","last_change":"2024-09-19T08:59:22.943778+0000","last_active":"2024-09-19T09:01:45.260631+0000","last_peered":"2024-09-19T09:01:45.260631+0000","last_clean":"2024-09-19T09:01:45.260631+0000","last_became_active":"2024-09-19T08:59:22.943357+0000","last_became_peered":"2024-09-19T08:59:22.943357+0000","last_unstale":"2024-09-19T09:01:45.260631+0000","last_undegraded":"2024-09-19T09:01:45.260631+0000","last_fullsized":"2024-09-19T09:01:45.260631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:55:57.183363+0000","last_clean_scrub_stamp":"2024-09-19T08:55:57.183363+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:02.301026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260842+0000","last_change":"2024-09-19T09:00:44.135446+0000","last_active":"2024-09-19T09:01:45.260842+0000","last_peered":"2024-09-19T09:01:45.260842+0000","last_clean":"2024-09-19T09:01:45.260842+0000","last_became_active":"2024-09-19T09:00:44.135030+0000","last_became_peered":"2024-09-19T09:00:44.135030+0000","last_unstale":"2024-09-19T09:01:45.260842+0000","last_undegraded":"2024-09-19T09:01:45.260842+0000","last_fullsized":"2024-09-19T09:01:45.260842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:13.588934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.261065+0000","last_change":"2024-09-19T09:00:37.079569+0000","last_active":"2024-09-19T09:01:45.261065+0000","last_peered":"2024-09-19T09:01:45.261065+0000","last_clean":"2024-09-19T09:01:45.261065+0000","last_became_active":"2024-09-19T09:00:37.079089+0000","last_became_peered":"2024-09-19T09:00:37.079089+0000","last_unstale":"2024-09-19T09:01:45.261065+0000","last_undegraded":"2024-09-19T09:01:45.261065+0000","last_fullsized":"2024-09-19T09:01:45.261065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:56.122258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":79,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:06.256395+0000","last_change":"2024-09-19T09:00:44.125607+0000","last_active":"2024-09-19T09:02:06.256395+0000","last_peered":"2024-09-19T09:02:06.256395+0000","last_clean":"2024-09-19T09:02:06.256395+0000","last_became_active":"2024-09-19T09:00:44.125236+0000","last_became_peered":"2024-09-19T09:00:44.125236+0000","last_unstale":"2024-09-19T09:02:06.256395+0000","last_undegraded":"2024-09-19T09:02:06.256395+0000","last_fullsized":"2024-09-19T09:02:06.256395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:21.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999408+0000","last_change":"2024-09-19T09:00:44.136886+0000","last_active":"2024-09-19T09:01:44.999408+0000","last_peered":"2024-09-19T09:01:44.999408+0000","last_clean":"2024-09-19T09:01:44.999408+0000","last_became_active":"2024-09-19T09:00:44.136394+0000","last_became_peered":"2024-09-19T09:00:44.136394+0000","last_unstale":"2024-09-19T09:01:44.999408+0000","last_undegraded":"2024-09-19T09:01:44.999408+0000","last_fullsized":"2024-09-19T09:01:44.999408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.680203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260771+0000","last_change":"2024-09-19T09:00:37.081017+0000","last_active":"2024-09-19T09:01:45.260771+0000","last_peered":"2024-09-19T09:01:45.260771+0000","last_clean":"2024-09-19T09:01:45.260771+0000","last_became_active":"2024-09-19T09:00:37.080674+0000","last_became_peered":"2024-09-19T09:00:37.080674+0000","last_unstale":"2024-09-19T09:01:45.260771+0000","last_undegraded":"2024-09-19T09:01:45.260771+0000","last_fullsized":"2024-09-19T09:01:45.260771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:07.247315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240472+0000","last_change":"2024-09-19T09:00:35.056009+0000","last_active":"2024-09-19T09:01:45.240472+0000","last_peered":"2024-09-19T09:01:45.240472+0000","last_clean":"2024-09-19T09:01:45.240472+0000","last_became_active":"2024-09-19T09:00:35.055651+0000","last_became_peered":"2024-09-19T09:00:35.055651+0000","last_unstale":"2024-09-19T09:01:45.240472+0000","last_undegraded":"2024-09-19T09:01:45.240472+0000","last_fullsized":"2024-09-19T09:01:45.240472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:36.726272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245558+0000","last_change":"2024-09-19T09:00:44.135629+0000","last_active":"2024-09-19T09:01:45.245558+0000","last_peered":"2024-09-19T09:01:45.245558+0000","last_clean":"2024-09-19T09:01:45.245558+0000","last_became_active":"2024-09-19T09:00:44.135253+0000","last_became_peered":"2024-09-19T09:00:44.135253+0000","last_unstale":"2024-09-19T09:01:45.245558+0000","last_undegraded":"2024-09-19T09:01:45.245558+0000","last_fullsized":"2024-09-19T09:01:45.245558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:37.767455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260914+0000","last_change":"2024-09-19T09:00:37.084042+0000","last_active":"2024-09-19T09:01:45.260914+0000","last_peered":"2024-09-19T09:01:45.260914+0000","last_clean":"2024-09-19T09:01:45.260914+0000","last_became_active":"2024-09-19T09:00:37.083512+0000","last_became_peered":"2024-09-19T09:00:37.083512+0000","last_unstale":"2024-09-19T09:01:45.260914+0000","last_undegraded":"2024-09-19T09:01:45.260914+0000","last_fullsized":"2024-09-19T09:01:45.260914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:07.760004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246666+0000","last_change":"2024-09-19T09:00:35.056202+0000","last_active":"2024-09-19T09:01:45.246666+0000","last_peered":"2024-09-19T09:01:45.246666+0000","last_clean":"2024-09-19T09:01:45.246666+0000","last_became_active":"2024-09-19T09:00:35.055867+0000","last_became_peered":"2024-09-19T09:00:35.055867+0000","last_unstale":"2024-09-19T09:01:45.246666+0000","last_undegraded":"2024-09-19T09:01:45.246666+0000","last_fullsized":"2024-09-19T09:01:45.246666+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:08.852400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239571+0000","last_change":"2024-09-19T09:00:44.133928+0000","last_active":"2024-09-19T09:01:45.239571+0000","last_peered":"2024-09-19T09:01:45.239571+0000","last_clean":"2024-09-19T09:01:45.239571+0000","last_became_active":"2024-09-19T09:00:44.133077+0000","last_became_peered":"2024-09-19T09:00:44.133077+0000","last_unstale":"2024-09-19T09:01:45.239571+0000","last_undegraded":"2024-09-19T09:01:45.239571+0000","last_fullsized":"2024-09-19T09:01:45.239571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:37.349942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245229+0000","last_change":"2024-09-19T09:00:37.080009+0000","last_active":"2024-09-19T09:01:45.245229+0000","last_peered":"2024-09-19T09:01:45.245229+0000","last_clean":"2024-09-19T09:01:45.245229+0000","last_became_active":"2024-09-19T09:00:37.079291+0000","last_became_peered":"2024-09-19T09:00:37.079291+0000","last_unstale":"2024-09-19T09:01:45.245229+0000","last_undegraded":"2024-09-19T09:01:45.245229+0000","last_fullsized":"2024-09-19T09:01:45.245229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:59.095093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001267+0000","last_change":"2024-09-19T09:00:35.058866+0000","last_active":"2024-09-19T09:01:45.001267+0000","last_peered":"2024-09-19T09:01:45.001267+0000","last_clean":"2024-09-19T09:01:45.001267+0000","last_became_active":"2024-09-19T09:00:35.058318+0000","last_became_peered":"2024-09-19T09:00:35.058318+0000","last_unstale":"2024-09-19T09:01:45.001267+0000","last_undegraded":"2024-09-19T09:01:45.001267+0000","last_fullsized":"2024-09-19T09:01:45.001267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:32.183063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239614+0000","last_change":"2024-09-19T09:00:44.136564+0000","last_active":"2024-09-19T09:01:45.239614+0000","last_peered":"2024-09-19T09:01:45.239614+0000","last_clean":"2024-09-19T09:01:45.239614+0000","last_became_active":"2024-09-19T09:00:44.136192+0000","last_became_peered":"2024-09-19T09:00:44.136192+0000","last_unstale":"2024-09-19T09:01:45.239614+0000","last_undegraded":"2024-09-19T09:01:45.239614+0000","last_fullsized":"2024-09-19T09:01:45.239614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:17.856055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239775+0000","last_change":"2024-09-19T09:00:37.079611+0000","last_active":"2024-09-19T09:01:45.239775+0000","last_peered":"2024-09-19T09:01:45.239775+0000","last_clean":"2024-09-19T09:01:45.239775+0000","last_became_active":"2024-09-19T09:00:37.079135+0000","last_became_peered":"2024-09-19T09:00:37.079135+0000","last_unstale":"2024-09-19T09:01:45.239775+0000","last_undegraded":"2024-09-19T09:01:45.239775+0000","last_fullsized":"2024-09-19T09:01:45.239775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:24.321754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244683+0000","last_change":"2024-09-19T09:00:44.144312+0000","last_active":"2024-09-19T09:01:45.244683+0000","last_peered":"2024-09-19T09:01:45.244683+0000","last_clean":"2024-09-19T09:01:45.244683+0000","last_became_active":"2024-09-19T09:00:44.128920+0000","last_became_peered":"2024-09-19T09:00:44.128920+0000","last_unstale":"2024-09-19T09:01:45.244683+0000","last_undegraded":"2024-09-19T09:01:45.244683+0000","last_fullsized":"2024-09-19T09:01:45.244683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:06.640129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246565+0000","last_change":"2024-09-19T09:00:44.134009+0000","last_active":"2024-09-19T09:01:45.246565+0000","last_peered":"2024-09-19T09:01:45.246565+0000","last_clean":"2024-09-19T09:01:45.246565+0000","last_became_active":"2024-09-19T09:00:44.133634+0000","last_became_peered":"2024-09-19T09:00:44.133634+0000","last_unstale":"2024-09-19T09:01:45.246565+0000","last_undegraded":"2024-09-19T09:01:45.246565+0000","last_fullsized":"2024-09-19T09:01:45.246565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.591618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260305+0000","last_change":"2024-09-19T09:00:37.082614+0000","last_active":"2024-09-19T09:01:45.260305+0000","last_peered":"2024-09-19T09:01:45.260305+0000","last_clean":"2024-09-19T09:01:45.260305+0000","last_became_active":"2024-09-19T09:00:37.082316+0000","last_became_peered":"2024-09-19T09:00:37.082316+0000","last_unstale":"2024-09-19T09:01:45.260305+0000","last_undegraded":"2024-09-19T09:01:45.260305+0000","last_fullsized":"2024-09-19T09:01:45.260305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:21.982971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":96,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:06.277943+0000","last_change":"2024-09-19T09:00:35.057270+0000","last_active":"2024-09-19T09:02:06.277943+0000","last_peered":"2024-09-19T09:02:06.277943+0000","last_clean":"2024-09-19T09:02:06.277943+0000","last_became_active":"2024-09-19T09:00:35.056955+0000","last_became_peered":"2024-09-19T09:00:35.056955+0000","last_unstale":"2024-09-19T09:02:06.277943+0000","last_undegraded":"2024-09-19T09:02:06.277943+0000","last_fullsized":"2024-09-19T09:02:06.277943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:11.609975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.262086+0000","last_change":"2024-09-19T09:01:45.262086+0000","last_active":"2024-09-19T09:01:45.262086+0000","last_peered":"2024-09-19T09:01:45.262086+0000","last_clean":"2024-09-19T09:01:45.262086+0000","last_became_active":"2024-09-19T09:01:45.261708+0000","last_became_peered":"2024-09-19T09:01:45.261708+0000","last_unstale":"2024-09-19T09:01:45.262086+0000","last_undegraded":"2024-09-19T09:01:45.262086+0000","last_fullsized":"2024-09-19T09:01:45.262086+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:09.056725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260759+0000","last_change":"2024-09-19T09:00:37.076171+0000","last_active":"2024-09-19T09:01:45.260759+0000","last_peered":"2024-09-19T09:01:45.260759+0000","last_clean":"2024-09-19T09:01:45.260759+0000","last_became_active":"2024-09-19T09:00:37.074936+0000","last_became_peered":"2024-09-19T09:00:37.074936+0000","last_unstale":"2024-09-19T09:01:45.260759+0000","last_undegraded":"2024-09-19T09:01:45.260759+0000","last_fullsized":"2024-09-19T09:01:45.260759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:40.122044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240013+0000","last_change":"2024-09-19T09:00:35.055349+0000","last_active":"2024-09-19T09:01:45.240013+0000","last_peered":"2024-09-19T09:01:45.240013+0000","last_clean":"2024-09-19T09:01:45.240013+0000","last_became_active":"2024-09-19T09:00:35.054406+0000","last_became_peered":"2024-09-19T09:00:35.054406+0000","last_unstale":"2024-09-19T09:01:45.240013+0000","last_undegraded":"2024-09-19T09:01:45.240013+0000","last_fullsized":"2024-09-19T09:01:45.240013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:01.640009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244968+0000","last_change":"2024-09-19T09:00:44.133083+0000","last_active":"2024-09-19T09:01:45.244968+0000","last_peered":"2024-09-19T09:01:45.244968+0000","last_clean":"2024-09-19T09:01:45.244968+0000","last_became_active":"2024-09-19T09:00:44.132661+0000","last_became_peered":"2024-09-19T09:00:44.132661+0000","last_unstale":"2024-09-19T09:01:45.244968+0000","last_undegraded":"2024-09-19T09:01:45.244968+0000","last_fullsized":"2024-09-19T09:01:45.244968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:24.272169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246701+0000","last_change":"2024-09-19T09:00:37.073915+0000","last_active":"2024-09-19T09:01:45.246701+0000","last_peered":"2024-09-19T09:01:45.246701+0000","last_clean":"2024-09-19T09:01:45.246701+0000","last_became_active":"2024-09-19T09:00:37.073560+0000","last_became_peered":"2024-09-19T09:00:37.073560+0000","last_unstale":"2024-09-19T09:01:45.246701+0000","last_undegraded":"2024-09-19T09:01:45.246701+0000","last_fullsized":"2024-09-19T09:01:45.246701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.989827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000042+0000","last_change":"2024-09-19T09:00:35.056260+0000","last_active":"2024-09-19T09:01:45.000042+0000","last_peered":"2024-09-19T09:01:45.000042+0000","last_clean":"2024-09-19T09:01:45.000042+0000","last_became_active":"2024-09-19T09:00:35.055862+0000","last_became_peered":"2024-09-19T09:00:35.055862+0000","last_unstale":"2024-09-19T09:01:45.000042+0000","last_undegraded":"2024-09-19T09:01:45.000042+0000","last_fullsized":"2024-09-19T09:01:45.000042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:12.642021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240194+0000","last_change":"2024-09-19T09:00:44.132934+0000","last_active":"2024-09-19T09:01:45.240194+0000","last_peered":"2024-09-19T09:01:45.240194+0000","last_clean":"2024-09-19T09:01:45.240194+0000","last_became_active":"2024-09-19T09:00:44.132417+0000","last_became_peered":"2024-09-19T09:00:44.132417+0000","last_unstale":"2024-09-19T09:01:45.240194+0000","last_undegraded":"2024-09-19T09:01:45.240194+0000","last_fullsized":"2024-09-19T09:01:45.240194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:19.363149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000300+0000","last_change":"2024-09-19T09:00:37.081436+0000","last_active":"2024-09-19T09:01:45.000300+0000","last_peered":"2024-09-19T09:01:45.000300+0000","last_clean":"2024-09-19T09:01:45.000300+0000","last_became_active":"2024-09-19T09:00:37.081114+0000","last_became_peered":"2024-09-19T09:00:37.081114+0000","last_unstale":"2024-09-19T09:01:45.000300+0000","last_undegraded":"2024-09-19T09:01:45.000300+0000","last_fullsized":"2024-09-19T09:01:45.000300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:54.360471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'34","reported_seq":187,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:09.281547+0000","last_change":"2024-09-19T09:00:35.056632+0000","last_active":"2024-09-19T09:02:09.281547+0000","last_peered":"2024-09-19T09:02:09.281547+0000","last_clean":"2024-09-19T09:02:09.281547+0000","last_became_active":"2024-09-19T09:00:35.055468+0000","last_became_peered":"2024-09-19T09:00:35.055468+0000","last_unstale":"2024-09-19T09:02:09.281547+0000","last_undegraded":"2024-09-19T09:02:09.281547+0000","last_fullsized":"2024-09-19T09:02:09.281547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:01.820894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62076,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":120,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998147+0000","last_change":"2024-09-19T09:00:44.128870+0000","last_active":"2024-09-19T09:01:44.998147+0000","last_peered":"2024-09-19T09:01:44.998147+0000","last_clean":"2024-09-19T09:01:44.998147+0000","last_became_active":"2024-09-19T09:00:44.128494+0000","last_became_peered":"2024-09-19T09:00:44.128494+0000","last_unstale":"2024-09-19T09:01:44.998147+0000","last_undegraded":"2024-09-19T09:01:44.998147+0000","last_fullsized":"2024-09-19T09:01:44.998147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:20.208407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000468+0000","last_change":"2024-09-19T09:00:37.086507+0000","last_active":"2024-09-19T09:01:45.000468+0000","last_peered":"2024-09-19T09:01:45.000468+0000","last_clean":"2024-09-19T09:01:45.000468+0000","last_became_active":"2024-09-19T09:00:37.086051+0000","last_became_peered":"2024-09-19T09:00:37.086051+0000","last_unstale":"2024-09-19T09:01:45.000468+0000","last_undegraded":"2024-09-19T09:01:45.000468+0000","last_fullsized":"2024-09-19T09:01:45.000468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:31.301804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240365+0000","last_change":"2024-09-19T09:00:35.501772+0000","last_active":"2024-09-19T09:01:45.240365+0000","last_peered":"2024-09-19T09:01:45.240365+0000","last_clean":"2024-09-19T09:01:45.240365+0000","last_became_active":"2024-09-19T09:00:35.501413+0000","last_became_peered":"2024-09-19T09:00:35.501413+0000","last_unstale":"2024-09-19T09:01:45.240365+0000","last_undegraded":"2024-09-19T09:01:45.240365+0000","last_fullsized":"2024-09-19T09:01:45.240365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:31.806234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.004063+0000","last_change":"2024-09-19T09:01:45.004063+0000","last_active":"2024-09-19T09:01:45.004063+0000","last_peered":"2024-09-19T09:01:45.004063+0000","last_clean":"2024-09-19T09:01:45.004063+0000","last_became_active":"2024-09-19T09:01:45.003631+0000","last_became_peered":"2024-09-19T09:01:45.003631+0000","last_unstale":"2024-09-19T09:01:45.004063+0000","last_undegraded":"2024-09-19T09:01:45.004063+0000","last_fullsized":"2024-09-19T09:01:45.004063+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:52.674340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245571+0000","last_change":"2024-09-19T09:00:37.078120+0000","last_active":"2024-09-19T09:01:45.245571+0000","last_peered":"2024-09-19T09:01:45.245571+0000","last_clean":"2024-09-19T09:01:45.245571+0000","last_became_active":"2024-09-19T09:00:37.077885+0000","last_became_peered":"2024-09-19T09:00:37.077885+0000","last_unstale":"2024-09-19T09:01:45.245571+0000","last_undegraded":"2024-09-19T09:01:45.245571+0000","last_fullsized":"2024-09-19T09:01:45.245571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:01.841615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260942+0000","last_change":"2024-09-19T09:00:35.059612+0000","last_active":"2024-09-19T09:01:45.260942+0000","last_peered":"2024-09-19T09:01:45.260942+0000","last_clean":"2024-09-19T09:01:45.260942+0000","last_became_active":"2024-09-19T09:00:35.059191+0000","last_became_peered":"2024-09-19T09:00:35.059191+0000","last_unstale":"2024-09-19T09:01:45.260942+0000","last_undegraded":"2024-09-19T09:01:45.260942+0000","last_fullsized":"2024-09-19T09:01:45.260942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:06.600073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246747+0000","last_change":"2024-09-19T09:01:45.246747+0000","last_active":"2024-09-19T09:01:45.246747+0000","last_peered":"2024-09-19T09:01:45.246747+0000","last_clean":"2024-09-19T09:01:45.246747+0000","last_became_active":"2024-09-19T09:01:45.246188+0000","last_became_peered":"2024-09-19T09:01:45.246188+0000","last_unstale":"2024-09-19T09:01:45.246747+0000","last_undegraded":"2024-09-19T09:01:45.246747+0000","last_fullsized":"2024-09-19T09:01:45.246747+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:02.319385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000213+0000","last_change":"2024-09-19T09:00:37.080025+0000","last_active":"2024-09-19T09:01:45.000213+0000","last_peered":"2024-09-19T09:01:45.000213+0000","last_clean":"2024-09-19T09:01:45.000213+0000","last_became_active":"2024-09-19T09:00:37.078012+0000","last_became_peered":"2024-09-19T09:00:37.078012+0000","last_unstale":"2024-09-19T09:01:45.000213+0000","last_undegraded":"2024-09-19T09:01:45.000213+0000","last_fullsized":"2024-09-19T09:01:45.000213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:25.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:09.259575+0000","last_change":"2024-09-19T09:00:35.059391+0000","last_active":"2024-09-19T09:02:09.259575+0000","last_peered":"2024-09-19T09:02:09.259575+0000","last_clean":"2024-09-19T09:02:09.259575+0000","last_became_active":"2024-09-19T09:00:35.059049+0000","last_became_peered":"2024-09-19T09:00:35.059049+0000","last_unstale":"2024-09-19T09:02:09.259575+0000","last_undegraded":"2024-09-19T09:02:09.259575+0000","last_fullsized":"2024-09-19T09:02:09.259575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:00.531411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245161+0000","last_change":"2024-09-19T09:00:44.133665+0000","last_active":"2024-09-19T09:01:45.245161+0000","last_peered":"2024-09-19T09:01:45.245161+0000","last_clean":"2024-09-19T09:01:45.245161+0000","last_became_active":"2024-09-19T09:00:44.133297+0000","last_became_peered":"2024-09-19T09:00:44.133297+0000","last_unstale":"2024-09-19T09:01:45.245161+0000","last_undegraded":"2024-09-19T09:01:45.245161+0000","last_fullsized":"2024-09-19T09:01:45.245161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:18.279936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245223+0000","last_change":"2024-09-19T09:00:44.136292+0000","last_active":"2024-09-19T09:01:45.245223+0000","last_peered":"2024-09-19T09:01:45.245223+0000","last_clean":"2024-09-19T09:01:45.245223+0000","last_became_active":"2024-09-19T09:00:44.135914+0000","last_became_peered":"2024-09-19T09:00:44.135914+0000","last_unstale":"2024-09-19T09:01:45.245223+0000","last_undegraded":"2024-09-19T09:01:45.245223+0000","last_fullsized":"2024-09-19T09:01:45.245223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:00.998217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998018+0000","last_change":"2024-09-19T09:00:37.066933+0000","last_active":"2024-09-19T09:01:44.998018+0000","last_peered":"2024-09-19T09:01:44.998018+0000","last_clean":"2024-09-19T09:01:44.998018+0000","last_became_active":"2024-09-19T09:00:37.066634+0000","last_became_peered":"2024-09-19T09:00:37.066634+0000","last_unstale":"2024-09-19T09:01:44.998018+0000","last_undegraded":"2024-09-19T09:01:44.998018+0000","last_fullsized":"2024-09-19T09:01:44.998018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.665101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239832+0000","last_change":"2024-09-19T09:00:35.057495+0000","last_active":"2024-09-19T09:01:45.239832+0000","last_peered":"2024-09-19T09:01:45.239832+0000","last_clean":"2024-09-19T09:01:45.239832+0000","last_became_active":"2024-09-19T09:00:35.057093+0000","last_became_peered":"2024-09-19T09:00:35.057093+0000","last_unstale":"2024-09-19T09:01:45.239832+0000","last_undegraded":"2024-09-19T09:01:45.239832+0000","last_fullsized":"2024-09-19T09:01:45.239832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:41.278464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245204+0000","last_change":"2024-09-19T09:00:44.135353+0000","last_active":"2024-09-19T09:01:45.245204+0000","last_peered":"2024-09-19T09:01:45.245204+0000","last_clean":"2024-09-19T09:01:45.245204+0000","last_became_active":"2024-09-19T09:00:44.134467+0000","last_became_peered":"2024-09-19T09:00:44.134467+0000","last_unstale":"2024-09-19T09:01:45.245204+0000","last_undegraded":"2024-09-19T09:01:45.245204+0000","last_fullsized":"2024-09-19T09:01:45.245204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:28.795561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246159+0000","last_change":"2024-09-19T09:00:37.067368+0000","last_active":"2024-09-19T09:01:45.246159+0000","last_peered":"2024-09-19T09:01:45.246159+0000","last_clean":"2024-09-19T09:01:45.246159+0000","last_became_active":"2024-09-19T09:00:37.067081+0000","last_became_peered":"2024-09-19T09:00:37.067081+0000","last_unstale":"2024-09-19T09:01:45.246159+0000","last_undegraded":"2024-09-19T09:01:45.246159+0000","last_fullsized":"2024-09-19T09:01:45.246159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:42.069148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245092+0000","last_change":"2024-09-19T09:00:35.052775+0000","last_active":"2024-09-19T09:01:45.245092+0000","last_peered":"2024-09-19T09:01:45.245092+0000","last_clean":"2024-09-19T09:01:45.245092+0000","last_became_active":"2024-09-19T09:00:35.052419+0000","last_became_peered":"2024-09-19T09:00:35.052419+0000","last_unstale":"2024-09-19T09:01:45.245092+0000","last_undegraded":"2024-09-19T09:01:45.245092+0000","last_fullsized":"2024-09-19T09:01:45.245092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:40.156076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999895+0000","last_change":"2024-09-19T09:00:35.055043+0000","last_active":"2024-09-19T09:01:44.999895+0000","last_peered":"2024-09-19T09:01:44.999895+0000","last_clean":"2024-09-19T09:01:44.999895+0000","last_became_active":"2024-09-19T09:00:35.054653+0000","last_became_peered":"2024-09-19T09:00:35.054653+0000","last_unstale":"2024-09-19T09:01:44.999895+0000","last_undegraded":"2024-09-19T09:01:44.999895+0000","last_fullsized":"2024-09-19T09:01:44.999895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.834239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.240108+0000","last_change":"2024-09-19T09:00:37.077459+0000","last_active":"2024-09-19T09:01:45.240108+0000","last_peered":"2024-09-19T09:01:45.240108+0000","last_clean":"2024-09-19T09:01:45.240108+0000","last_became_active":"2024-09-19T09:00:37.077130+0000","last_became_peered":"2024-09-19T09:00:37.077130+0000","last_unstale":"2024-09-19T09:01:45.240108+0000","last_undegraded":"2024-09-19T09:01:45.240108+0000","last_fullsized":"2024-09-19T09:01:45.240108+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:36.752471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999807+0000","last_change":"2024-09-19T09:00:44.133996+0000","last_active":"2024-09-19T09:01:44.999807+0000","last_peered":"2024-09-19T09:01:44.999807+0000","last_clean":"2024-09-19T09:01:44.999807+0000","last_became_active":"2024-09-19T09:00:44.133628+0000","last_became_peered":"2024-09-19T09:00:44.133628+0000","last_unstale":"2024-09-19T09:01:44.999807+0000","last_undegraded":"2024-09-19T09:01:44.999807+0000","last_fullsized":"2024-09-19T09:01:44.999807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:50.332457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":93,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:02:05.269575+0000","last_change":"2024-09-19T09:00:35.053940+0000","last_active":"2024-09-19T09:02:05.269575+0000","last_peered":"2024-09-19T09:02:05.269575+0000","last_clean":"2024-09-19T09:02:05.269575+0000","last_became_active":"2024-09-19T09:00:35.053537+0000","last_became_peered":"2024-09-19T09:00:35.053537+0000","last_unstale":"2024-09-19T09:02:05.269575+0000","last_undegraded":"2024-09-19T09:02:05.269575+0000","last_fullsized":"2024-09-19T09:02:05.269575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:34.036978+0000","last_clean_scrub_stamp":"2024-09-19T09:00:34.036978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:34.127981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000534+0000","last_change":"2024-09-19T09:00:37.080739+0000","last_active":"2024-09-19T09:01:45.000534+0000","last_peered":"2024-09-19T09:01:45.000534+0000","last_clean":"2024-09-19T09:01:45.000534+0000","last_became_active":"2024-09-19T09:00:37.077474+0000","last_became_peered":"2024-09-19T09:00:37.077474+0000","last_unstale":"2024-09-19T09:01:45.000534+0000","last_undegraded":"2024-09-19T09:01:45.000534+0000","last_fullsized":"2024-09-19T09:01:45.000534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:50.963793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000471+0000","last_change":"2024-09-19T09:00:44.136011+0000","last_active":"2024-09-19T09:01:45.000471+0000","last_peered":"2024-09-19T09:01:45.000471+0000","last_clean":"2024-09-19T09:01:45.000471+0000","last_became_active":"2024-09-19T09:00:44.135614+0000","last_became_peered":"2024-09-19T09:00:44.135614+0000","last_unstale":"2024-09-19T09:01:45.000471+0000","last_undegraded":"2024-09-19T09:01:45.000471+0000","last_fullsized":"2024-09-19T09:01:45.000471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:43.102895+0000","last_clean_scrub_stamp":"2024-09-19T09:00:43.102895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:49.390677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244816+0000","last_change":"2024-09-19T09:00:37.081680+0000","last_active":"2024-09-19T09:01:45.244816+0000","last_peered":"2024-09-19T09:01:45.244816+0000","last_clean":"2024-09-19T09:01:45.244816+0000","last_became_active":"2024-09-19T09:00:37.081355+0000","last_became_peered":"2024-09-19T09:00:37.081355+0000","last_unstale":"2024-09-19T09:01:45.244816+0000","last_undegraded":"2024-09-19T09:01:45.244816+0000","last_fullsized":"2024-09-19T09:01:45.244816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:49.101880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999858+0000","last_change":"2024-09-19T09:00:37.076575+0000","last_active":"2024-09-19T09:01:44.999858+0000","last_peered":"2024-09-19T09:01:44.999858+0000","last_clean":"2024-09-19T09:01:44.999858+0000","last_became_active":"2024-09-19T09:00:37.076167+0000","last_became_peered":"2024-09-19T09:00:37.076167+0000","last_unstale":"2024-09-19T09:01:44.999858+0000","last_undegraded":"2024-09-19T09:01:44.999858+0000","last_fullsized":"2024-09-19T09:01:44.999858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:08.251308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999947+0000","last_change":"2024-09-19T09:00:37.080433+0000","last_active":"2024-09-19T09:01:44.999947+0000","last_peered":"2024-09-19T09:01:44.999947+0000","last_clean":"2024-09-19T09:01:44.999947+0000","last_became_active":"2024-09-19T09:00:37.074803+0000","last_became_peered":"2024-09-19T09:00:37.074803+0000","last_unstale":"2024-09-19T09:01:44.999947+0000","last_undegraded":"2024-09-19T09:01:44.999947+0000","last_fullsized":"2024-09-19T09:01:44.999947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:18.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245649+0000","last_change":"2024-09-19T09:00:37.073227+0000","last_active":"2024-09-19T09:01:45.245649+0000","last_peered":"2024-09-19T09:01:45.245649+0000","last_clean":"2024-09-19T09:01:45.245649+0000","last_became_active":"2024-09-19T09:00:37.072875+0000","last_became_peered":"2024-09-19T09:00:37.072875+0000","last_unstale":"2024-09-19T09:01:45.245649+0000","last_undegraded":"2024-09-19T09:01:45.245649+0000","last_fullsized":"2024-09-19T09:01:45.245649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:09.303029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246545+0000","last_change":"2024-09-19T09:00:37.077978+0000","last_active":"2024-09-19T09:01:45.246545+0000","last_peered":"2024-09-19T09:01:45.246545+0000","last_clean":"2024-09-19T09:01:45.246545+0000","last_became_active":"2024-09-19T09:00:37.077663+0000","last_became_peered":"2024-09-19T09:00:37.077663+0000","last_unstale":"2024-09-19T09:01:45.246545+0000","last_undegraded":"2024-09-19T09:01:45.246545+0000","last_fullsized":"2024-09-19T09:01:45.246545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:22.156471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245222+0000","last_change":"2024-09-19T09:00:37.086723+0000","last_active":"2024-09-19T09:01:45.245222+0000","last_peered":"2024-09-19T09:01:45.245222+0000","last_clean":"2024-09-19T09:01:45.245222+0000","last_became_active":"2024-09-19T09:00:37.086405+0000","last_became_peered":"2024-09-19T09:00:37.086405+0000","last_unstale":"2024-09-19T09:01:45.245222+0000","last_undegraded":"2024-09-19T09:01:45.245222+0000","last_fullsized":"2024-09-19T09:01:45.245222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:21.351964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000726+0000","last_change":"2024-09-19T09:00:37.083033+0000","last_active":"2024-09-19T09:01:45.000726+0000","last_peered":"2024-09-19T09:01:45.000726+0000","last_clean":"2024-09-19T09:01:45.000726+0000","last_became_active":"2024-09-19T09:00:37.082713+0000","last_became_peered":"2024-09-19T09:00:37.082713+0000","last_unstale":"2024-09-19T09:01:45.000726+0000","last_undegraded":"2024-09-19T09:01:45.000726+0000","last_fullsized":"2024-09-19T09:01:45.000726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:27.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245798+0000","last_change":"2024-09-19T09:00:37.076327+0000","last_active":"2024-09-19T09:01:45.245798+0000","last_peered":"2024-09-19T09:01:45.245798+0000","last_clean":"2024-09-19T09:01:45.245798+0000","last_became_active":"2024-09-19T09:00:37.076015+0000","last_became_peered":"2024-09-19T09:00:37.076015+0000","last_unstale":"2024-09-19T09:01:45.245798+0000","last_undegraded":"2024-09-19T09:01:45.245798+0000","last_fullsized":"2024-09-19T09:01:45.245798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.789995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.239679+0000","last_change":"2024-09-19T09:00:37.076633+0000","last_active":"2024-09-19T09:01:45.239679+0000","last_peered":"2024-09-19T09:01:45.239679+0000","last_clean":"2024-09-19T09:01:45.239679+0000","last_became_active":"2024-09-19T09:00:37.075725+0000","last_became_peered":"2024-09-19T09:00:37.075725+0000","last_unstale":"2024-09-19T09:01:45.239679+0000","last_undegraded":"2024-09-19T09:01:45.239679+0000","last_fullsized":"2024-09-19T09:01:45.239679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:44.927819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245328+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:01:45.245328+0000","last_peered":"2024-09-19T09:01:45.245328+0000","last_clean":"2024-09-19T09:01:45.245328+0000","last_became_active":"2024-09-19T09:00:37.084998+0000","last_became_peered":"2024-09-19T09:00:37.084998+0000","last_unstale":"2024-09-19T09:01:45.245328+0000","last_undegraded":"2024-09-19T09:01:45.245328+0000","last_fullsized":"2024-09-19T09:01:45.245328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:57.316550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999945+0000","last_change":"2024-09-19T09:00:37.076500+0000","last_active":"2024-09-19T09:01:44.999945+0000","last_peered":"2024-09-19T09:01:44.999945+0000","last_clean":"2024-09-19T09:01:44.999945+0000","last_became_active":"2024-09-19T09:00:37.076135+0000","last_became_peered":"2024-09-19T09:00:37.076135+0000","last_unstale":"2024-09-19T09:01:44.999945+0000","last_undegraded":"2024-09-19T09:01:44.999945+0000","last_fullsized":"2024-09-19T09:01:44.999945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:06.726704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246571+0000","last_change":"2024-09-19T09:00:37.074370+0000","last_active":"2024-09-19T09:01:45.246571+0000","last_peered":"2024-09-19T09:01:45.246571+0000","last_clean":"2024-09-19T09:01:45.246571+0000","last_became_active":"2024-09-19T09:00:37.074076+0000","last_became_peered":"2024-09-19T09:00:37.074076+0000","last_unstale":"2024-09-19T09:01:45.246571+0000","last_undegraded":"2024-09-19T09:01:45.246571+0000","last_fullsized":"2024-09-19T09:01:45.246571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:56.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.244989+0000","last_change":"2024-09-19T09:00:37.078887+0000","last_active":"2024-09-19T09:01:45.244989+0000","last_peered":"2024-09-19T09:01:45.244989+0000","last_clean":"2024-09-19T09:01:45.244989+0000","last_became_active":"2024-09-19T09:00:37.078192+0000","last_became_peered":"2024-09-19T09:00:37.078192+0000","last_unstale":"2024-09-19T09:01:45.244989+0000","last_undegraded":"2024-09-19T09:01:45.244989+0000","last_fullsized":"2024-09-19T09:01:45.244989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:12.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000652+0000","last_change":"2024-09-19T09:00:37.075932+0000","last_active":"2024-09-19T09:01:45.000652+0000","last_peered":"2024-09-19T09:01:45.000652+0000","last_clean":"2024-09-19T09:01:45.000652+0000","last_became_active":"2024-09-19T09:00:37.074637+0000","last_became_peered":"2024-09-19T09:00:37.074637+0000","last_unstale":"2024-09-19T09:01:45.000652+0000","last_undegraded":"2024-09-19T09:01:45.000652+0000","last_fullsized":"2024-09-19T09:01:45.000652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:27.423717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998386+0000","last_change":"2024-09-19T09:00:37.072804+0000","last_active":"2024-09-19T09:01:44.998386+0000","last_peered":"2024-09-19T09:01:44.998386+0000","last_clean":"2024-09-19T09:01:44.998386+0000","last_became_active":"2024-09-19T09:00:37.072500+0000","last_became_peered":"2024-09-19T09:00:37.072500+0000","last_unstale":"2024-09-19T09:01:44.998386+0000","last_undegraded":"2024-09-19T09:01:44.998386+0000","last_fullsized":"2024-09-19T09:01:44.998386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:56.035111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245383+0000","last_change":"2024-09-19T09:00:37.083195+0000","last_active":"2024-09-19T09:01:45.245383+0000","last_peered":"2024-09-19T09:01:45.245383+0000","last_clean":"2024-09-19T09:01:45.245383+0000","last_became_active":"2024-09-19T09:00:37.082332+0000","last_became_peered":"2024-09-19T09:00:37.082332+0000","last_unstale":"2024-09-19T09:01:45.245383+0000","last_undegraded":"2024-09-19T09:01:45.245383+0000","last_fullsized":"2024-09-19T09:01:45.245383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:12.802785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999403+0000","last_change":"2024-09-19T09:00:37.076955+0000","last_active":"2024-09-19T09:01:44.999403+0000","last_peered":"2024-09-19T09:01:44.999403+0000","last_clean":"2024-09-19T09:01:44.999403+0000","last_became_active":"2024-09-19T09:00:37.076637+0000","last_became_peered":"2024-09-19T09:00:37.076637+0000","last_unstale":"2024-09-19T09:01:44.999403+0000","last_undegraded":"2024-09-19T09:01:44.999403+0000","last_fullsized":"2024-09-19T09:01:44.999403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:51.181157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245160+0000","last_change":"2024-09-19T09:00:37.085273+0000","last_active":"2024-09-19T09:01:45.245160+0000","last_peered":"2024-09-19T09:01:45.245160+0000","last_clean":"2024-09-19T09:01:45.245160+0000","last_became_active":"2024-09-19T09:00:37.084976+0000","last_became_peered":"2024-09-19T09:00:37.084976+0000","last_unstale":"2024-09-19T09:01:45.245160+0000","last_undegraded":"2024-09-19T09:01:45.245160+0000","last_fullsized":"2024-09-19T09:01:45.245160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:23.120946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245398+0000","last_change":"2024-09-19T09:00:37.082788+0000","last_active":"2024-09-19T09:01:45.245398+0000","last_peered":"2024-09-19T09:01:45.245398+0000","last_clean":"2024-09-19T09:01:45.245398+0000","last_became_active":"2024-09-19T09:00:37.082460+0000","last_became_peered":"2024-09-19T09:00:37.082460+0000","last_unstale":"2024-09-19T09:01:45.245398+0000","last_undegraded":"2024-09-19T09:01:45.245398+0000","last_fullsized":"2024-09-19T09:01:45.245398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:17.191671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246480+0000","last_change":"2024-09-19T09:00:37.075908+0000","last_active":"2024-09-19T09:01:45.246480+0000","last_peered":"2024-09-19T09:01:45.246480+0000","last_clean":"2024-09-19T09:01:45.246480+0000","last_became_active":"2024-09-19T09:00:37.075579+0000","last_became_peered":"2024-09-19T09:00:37.075579+0000","last_unstale":"2024-09-19T09:01:45.246480+0000","last_undegraded":"2024-09-19T09:01:45.246480+0000","last_fullsized":"2024-09-19T09:01:45.246480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:53.620585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.001950+0000","last_change":"2024-09-19T09:00:37.084392+0000","last_active":"2024-09-19T09:01:45.001950+0000","last_peered":"2024-09-19T09:01:45.001950+0000","last_clean":"2024-09-19T09:01:45.001950+0000","last_became_active":"2024-09-19T09:00:37.084074+0000","last_became_peered":"2024-09-19T09:00:37.084074+0000","last_unstale":"2024-09-19T09:01:45.001950+0000","last_undegraded":"2024-09-19T09:01:45.001950+0000","last_fullsized":"2024-09-19T09:01:45.001950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:20.585494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260970+0000","last_change":"2024-09-19T09:00:37.084436+0000","last_active":"2024-09-19T09:01:45.260970+0000","last_peered":"2024-09-19T09:01:45.260970+0000","last_clean":"2024-09-19T09:01:45.260970+0000","last_became_active":"2024-09-19T09:00:37.083720+0000","last_became_peered":"2024-09-19T09:00:37.083720+0000","last_unstale":"2024-09-19T09:01:45.260970+0000","last_undegraded":"2024-09-19T09:01:45.260970+0000","last_fullsized":"2024-09-19T09:01:45.260970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.900914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000362+0000","last_change":"2024-09-19T09:00:37.080816+0000","last_active":"2024-09-19T09:01:45.000362+0000","last_peered":"2024-09-19T09:01:45.000362+0000","last_clean":"2024-09-19T09:01:45.000362+0000","last_became_active":"2024-09-19T09:00:37.080493+0000","last_became_peered":"2024-09-19T09:00:37.080493+0000","last_unstale":"2024-09-19T09:01:45.000362+0000","last_undegraded":"2024-09-19T09:01:45.000362+0000","last_fullsized":"2024-09-19T09:01:45.000362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:18.862965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000272+0000","last_change":"2024-09-19T09:00:37.079203+0000","last_active":"2024-09-19T09:01:45.000272+0000","last_peered":"2024-09-19T09:01:45.000272+0000","last_clean":"2024-09-19T09:01:45.000272+0000","last_became_active":"2024-09-19T09:00:37.078851+0000","last_became_peered":"2024-09-19T09:00:37.078851+0000","last_unstale":"2024-09-19T09:01:45.000272+0000","last_undegraded":"2024-09-19T09:01:45.000272+0000","last_fullsized":"2024-09-19T09:01:45.000272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:16.640023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.246105+0000","last_change":"2024-09-19T09:00:37.077327+0000","last_active":"2024-09-19T09:01:45.246105+0000","last_peered":"2024-09-19T09:01:45.246105+0000","last_clean":"2024-09-19T09:01:45.246105+0000","last_became_active":"2024-09-19T09:00:37.077016+0000","last_became_peered":"2024-09-19T09:00:37.077016+0000","last_unstale":"2024-09-19T09:01:45.246105+0000","last_undegraded":"2024-09-19T09:01:45.246105+0000","last_fullsized":"2024-09-19T09:01:45.246105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:39.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.260467+0000","last_change":"2024-09-19T09:00:37.081849+0000","last_active":"2024-09-19T09:01:45.260467+0000","last_peered":"2024-09-19T09:01:45.260467+0000","last_clean":"2024-09-19T09:01:45.260467+0000","last_became_active":"2024-09-19T09:00:37.081508+0000","last_became_peered":"2024-09-19T09:00:37.081508+0000","last_unstale":"2024-09-19T09:01:45.260467+0000","last_undegraded":"2024-09-19T09:01:45.260467+0000","last_fullsized":"2024-09-19T09:01:45.260467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:53.502987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.999775+0000","last_change":"2024-09-19T09:00:37.074201+0000","last_active":"2024-09-19T09:01:44.999775+0000","last_peered":"2024-09-19T09:01:44.999775+0000","last_clean":"2024-09-19T09:01:44.999775+0000","last_became_active":"2024-09-19T09:00:37.073833+0000","last_became_peered":"2024-09-19T09:00:37.073833+0000","last_unstale":"2024-09-19T09:01:44.999775+0000","last_undegraded":"2024-09-19T09:01:44.999775+0000","last_fullsized":"2024-09-19T09:01:44.999775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:45.016566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.000862+0000","last_change":"2024-09-19T09:00:37.078436+0000","last_active":"2024-09-19T09:01:45.000862+0000","last_peered":"2024-09-19T09:01:45.000862+0000","last_clean":"2024-09-19T09:01:45.000862+0000","last_became_active":"2024-09-19T09:00:37.077648+0000","last_became_peered":"2024-09-19T09:00:37.077648+0000","last_unstale":"2024-09-19T09:01:45.000862+0000","last_undegraded":"2024-09-19T09:01:45.000862+0000","last_fullsized":"2024-09-19T09:01:45.000862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:30.258856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:44.998325+0000","last_change":"2024-09-19T09:00:44.131018+0000","last_active":"2024-09-19T09:01:44.998325+0000","last_peered":"2024-09-19T09:01:44.998325+0000","last_clean":"2024-09-19T09:01:44.998325+0000","last_became_active":"2024-09-19T09:00:44.130698+0000","last_became_peered":"2024-09-19T09:00:44.130698+0000","last_unstale":"2024-09-19T09:01:44.998325+0000","last_undegraded":"2024-09-19T09:01:44.998325+0000","last_fullsized":"2024-09-19T09:01:44.998325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:57.552728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245212+0000","last_change":"2024-09-19T09:00:37.085490+0000","last_active":"2024-09-19T09:01:45.245212+0000","last_peered":"2024-09-19T09:01:45.245212+0000","last_clean":"2024-09-19T09:01:45.245212+0000","last_became_active":"2024-09-19T09:00:37.085171+0000","last_became_peered":"2024-09-19T09:00:37.085171+0000","last_unstale":"2024-09-19T09:01:45.245212+0000","last_undegraded":"2024-09-19T09:01:45.245212+0000","last_fullsized":"2024-09-19T09:01:45.245212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:48.252031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245320+0000","last_change":"2024-09-19T09:00:37.071638+0000","last_active":"2024-09-19T09:01:45.245320+0000","last_peered":"2024-09-19T09:01:45.245320+0000","last_clean":"2024-09-19T09:01:45.245320+0000","last_became_active":"2024-09-19T09:00:37.071303+0000","last_became_peered":"2024-09-19T09:00:37.071303+0000","last_unstale":"2024-09-19T09:01:45.245320+0000","last_undegraded":"2024-09-19T09:01:45.245320+0000","last_fullsized":"2024-09-19T09:01:45.245320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:41.590831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T09:01:45.245341+0000","last_change":"2024-09-19T09:00:37.083761+0000","last_active":"2024-09-19T09:01:45.245341+0000","last_peered":"2024-09-19T09:01:45.245341+0000","last_clean":"2024-09-19T09:01:45.245341+0000","last_became_active":"2024-09-19T09:00:37.079681+0000","last_became_peered":"2024-09-19T09:00:37.079681+0000","last_unstale":"2024-09-19T09:01:45.245341+0000","last_undegraded":"2024-09-19T09:01:45.245341+0000","last_fullsized":"2024-09-19T09:01:45.245341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:00:36.045033+0000","last_clean_scrub_stamp":"2024-09-19T09:00:36.045033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:35.104720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69284,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":578,"num_read_kb":368,"num_write":248,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776166,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1716224,"data_stored":1155116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939690,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":509857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201328,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":506027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1642496,"data_stored":1103031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1024000,"data_stored":501658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36960,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708192,"statfs":{"total":95995035648,"available":95957188608,"internally_reserved":0,"allocated":1650688,"data_stored":1097827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1040384,"data_stored":506902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":500973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1101824,"data_stored":563421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1089536,"data_stored":564764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":502721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:02:12.130 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:02:12.130 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:02:12.130 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:02:12.131 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:02:12.378 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:12 smithi184 ceph-mon[35007]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:12 smithi122 ceph-mon[34247]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:12 smithi083 ceph-mon[30926]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 -- 172.21.15.83:0/956174416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0106f70 msgr2=0x7f1cc010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 --2- 172.21.15.83:0/956174416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0106f70 0x7f1cc010eab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009ca0 tx=0x7f1cb802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 -- 172.21.15.83:0/956174416 shutdown_connections 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 --2- 172.21.15.83:0/956174416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0106f70 0x7f1cc010eab0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 --2- 172.21.15.83:0/956174416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc0100eb0 0x7f1cc0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 --2- 172.21.15.83:0/956174416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0100500 0x7f1cc01008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 -- 172.21.15.83:0/956174416 >> 172.21.15.83:0/956174416 conn(0x7f1cc00fc5c0 msgr2=0x7f1cc00fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 -- 172.21.15.83:0/956174416 shutdown_connections 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.843+0000 7f1cc643a640 1 -- 172.21.15.83:0/956174416 wait complete. 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 Processor -- start 2024-09-19T09:02:12.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 -- start start 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc0100500 0x7f1cc0101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 0x7f1cc01019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0106f70 0x7f1cc0101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0111e80 con 0x7f1cc0100eb0 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0111d00 con 0x7f1cc0106f70 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc643a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0112000 con 0x7f1cc0100500 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cbf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 0x7f1cc01019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cbf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 0x7f1cc01019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46936/0 (socket says 172.21.15.83:46936) 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cbf7fe640 1 -- 172.21.15.83:0/929169090 learned_addr learned my addr 172.21.15.83:0/929169090 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cc49d7640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0106f70 0x7f1cc0101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cbf7fe640 1 -- 172.21.15.83:0/929169090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc0100500 msgr2=0x7f1cc0101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.844+0000 7f1cbffff640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc0100500 0x7f1cc0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbf7fe640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc0100500 0x7f1cc0101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbf7fe640 1 -- 172.21.15.83:0/929169090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0106f70 msgr2=0x7f1cc0101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbf7fe640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0106f70 0x7f1cc0101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbf7fe640 1 -- 172.21.15.83:0/929169090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc01a6860 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cc49d7640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0106f70 0x7f1cc0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbf7fe640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 0x7f1cc01019c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4006fd0 tx=0x7f1cb400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4011830 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cb4016070 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc01a6b50 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4010df0 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.845+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc01a7090 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.846+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc01008e0 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.847+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1cb40119d0 con 0x7f1cc0100eb0 2024-09-19T09:02:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.848+0000 7f1cbd7fa640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ca80a3350 0x7f1ca80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.848+0000 7f1cbffff640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ca80a3350 0x7f1ca80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.848+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1cb40cf310 con 0x7f1cc0100eb0 2024-09-19T09:02:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.848+0000 7f1cbffff640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ca80a3350 0x7f1ca80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0069fc0 tx=0x7f1cb0005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:12.852+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cb409bd20 con 0x7f1cc0100eb0 2024-09-19T09:02:13.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.056+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1cc002d7c0 con 0x7f1cc0100eb0 2024-09-19T09:02:13.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.056+0000 7f1cbd7fa640 1 -- 172.21.15.83:0/929169090 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1cb409b620 con 0x7f1cc0100eb0 2024-09-19T09:02:13.058 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:13.058 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:02:13.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ca80a3350 msgr2=0x7f1ca80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:13.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ca80a3350 0x7f1ca80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0069fc0 tx=0x7f1cb0005c60 comp rx=0 tx=0).stop 2024-09-19T09:02:13.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 msgr2=0x7f1cc01019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:13.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 0x7f1cc01019c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4006fd0 tx=0x7f1cb400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 shutdown_connections 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ca80a3350 0x7f1ca80a5810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cc0106f70 0x7f1cc0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cc0100eb0 0x7f1cc01019c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 --2- 172.21.15.83:0/929169090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc0100500 0x7f1cc0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 >> 172.21.15.83:0/929169090 conn(0x7f1cc00fc5c0 msgr2=0x7f1cc00fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 shutdown_connections 2024-09-19T09:02:13.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:13.058+0000 7f1cc643a640 1 -- 172.21.15.83:0/929169090 wait complete. 2024-09-19T09:02:13.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:13 smithi184 ceph-mon[35007]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:13.429 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:13 smithi083 ceph-mon[30926]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:13.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:13 smithi122 ceph-mon[34247]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:13.868 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:02:13.869 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:14.113 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:14 smithi083 ceph-mon[30926]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:14 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/929169090' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:02:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:14 smithi184 ceph-mon[35007]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:14 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/929169090' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:02:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:14 smithi122 ceph-mon[34247]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:14 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/929169090' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 -- 172.21.15.83:0/1344522047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 msgr2=0x7ff08010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 --2- 172.21.15.83:0/1344522047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff08010ea90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff078009ca0 tx=0x7ff07802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 -- 172.21.15.83:0/1344522047 shutdown_connections 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 --2- 172.21.15.83:0/1344522047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff08010ea90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 --2- 172.21.15.83:0/1344522047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff080102790 0x7ff0801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 --2- 172.21.15.83:0/1344522047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff080101de0 0x7ff0801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 -- 172.21.15.83:0/1344522047 >> 172.21.15.83:0/1344522047 conn(0x7ff0800fd8c0 msgr2=0x7ff0800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 -- 172.21.15.83:0/1344522047 shutdown_connections 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 -- 172.21.15.83:0/1344522047 wait complete. 2024-09-19T09:02:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 Processor -- start 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.633+0000 7ff0883e5640 1 -- start start 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff0883e5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff080101de0 0x7ff0800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff0883e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff080102790 0x7ff080074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff0883e5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff080074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff0883e5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff080111e20 con 0x7ff080106f10 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff0883e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff080111ca0 con 0x7ff080102790 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff0883e5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff080111fa0 con 0x7ff080101de0 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff080074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff080074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46954/0 (socket says 172.21.15.83:46954) 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 -- 172.21.15.83:0/4269473828 learned_addr learned my addr 172.21.15.83:0/4269473828 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086181640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff080101de0 0x7ff0800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff085980640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff080102790 0x7ff080074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 -- 172.21.15.83:0/4269473828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff080101de0 msgr2=0x7ff0800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff080101de0 0x7ff0800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 -- 172.21.15.83:0/4269473828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff080102790 msgr2=0x7ff080074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff080102790 0x7ff080074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 -- 172.21.15.83:0/4269473828 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0801a67e0 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.634+0000 7ff086982640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff080074f70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff078009dc0 tx=0x7ff078032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.635+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078003cf0 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.635+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0780044f0 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.635+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0801a6a70 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.635+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078030bf0 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.635+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0801a7000 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.636+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0801021c0 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.637+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff078004040 con 0x7ff080106f10 2024-09-19T09:02:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.637+0000 7ff0777fe640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff06c0a3350 0x7ff06c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.638+0000 7ff086181640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff06c0a3350 0x7ff06c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.638+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff0780f1350 con 0x7ff080106f10 2024-09-19T09:02:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.638+0000 7ff086181640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff06c0a3350 0x7ff06c0a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff07c005fd0 tx=0x7ff07c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.640+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0780bdd60 con 0x7ff080106f10 2024-09-19T09:02:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.842+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff08010a150 con 0x7ff080106f10 2024-09-19T09:02:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.843+0000 7ff0777fe640 1 -- 172.21.15.83:0/4269473828 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7ff0780bd660 con 0x7ff080106f10 2024-09-19T09:02:14.844 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"btime":"2024-09-19T09:01:17:195983+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:01:16.785988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[14583,24476,24430,24443,24445]},"id":1}]} 2024-09-19T09:02:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:02:14.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff06c0a3350 msgr2=0x7ff06c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff06c0a3350 0x7ff06c0a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff07c005fd0 tx=0x7ff07c00b390 comp rx=0 tx=0).stop 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 msgr2=0x7ff080074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff080074f70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff078009dc0 tx=0x7ff078032ff0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 shutdown_connections 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7ff06c0a3350 0x7ff06c0a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff080106f10 0x7ff080074f70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff080102790 0x7ff080074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 --2- 172.21.15.83:0/4269473828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff080101de0 0x7ff0800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 >> 172.21.15.83:0/4269473828 conn(0x7ff0800fd8c0 msgr2=0x7ff0800fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 shutdown_connections 2024-09-19T09:02:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:14.845+0000 7ff0883e5640 1 -- 172.21.15.83:0/4269473828 wait complete. 2024-09-19T09:02:15.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:15 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4269473828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:15.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:15 smithi083 ceph-mon[30926]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:15 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4269473828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:15.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:15 smithi184 ceph-mon[35007]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:15.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:15 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4269473828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:15 smithi122 ceph-mon[34247]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:15.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:15.782 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:16.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 -- 172.21.15.83:0/1967781238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 msgr2=0x7f0c801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1967781238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c801029b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009900 tx=0x7f0c6802a480 comp rx=0 tx=0).stop 2024-09-19T09:02:16.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 -- 172.21.15.83:0/1967781238 shutdown_connections 2024-09-19T09:02:16.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1967781238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c80102ef0 0x7f0c8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1967781238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c801029b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1967781238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c80100e20 0x7f0c80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 -- 172.21.15.83:0/1967781238 >> 172.21.15.83:0/1967781238 conn(0x7f0c800fc7d0 msgr2=0x7f0c800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 -- 172.21.15.83:0/1967781238 shutdown_connections 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 -- 172.21.15.83:0/1967781238 wait complete. 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 Processor -- start 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.311+0000 7f0c85b61640 1 -- start start 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c80100e20 0x7f0c800fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c800fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c80102ef0 0x7f0c800fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80110e50 con 0x7f0c80102570 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80110cd0 con 0x7f0c80102ef0 2024-09-19T09:02:16.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80110fd0 con 0x7f0c80100e20 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c800fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c800fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46960/0 (socket says 172.21.15.83:46960) 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 -- 172.21.15.83:0/1653255003 learned_addr learned my addr 172.21.15.83:0/1653255003 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c7f7fe640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c80100e20 0x7f0c800fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c7ffff640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c80102ef0 0x7f0c800fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 -- 172.21.15.83:0/1653255003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c80100e20 msgr2=0x7f0c800fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c80100e20 0x7f0c800fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 -- 172.21.15.83:0/1653255003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c80102ef0 msgr2=0x7f0c800fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c80102ef0 0x7f0c800fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 -- 172.21.15.83:0/1653255003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c801a68d0 con 0x7f0c80102570 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c77fff640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c800fd1c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0c68006010 tx=0x7f0c680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:16.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6803f070 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c68003aa0 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c801a6b60 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.312+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68035030 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.313+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c801a7040 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.314+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c80101200 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.314+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0c68042070 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.315+0000 7f0c7d7fa640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0c6c0a32d0 0x7f0c6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.315+0000 7f0c7f7fe640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0c6c0a32d0 0x7f0c6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.315+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f0c680f0460 con 0x7f0c80102570 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.316+0000 7f0c7f7fe640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0c6c0a32d0 0x7f0c6c0a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005e10 tx=0x7f0c70005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:16.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.319+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c680bccc0 con 0x7f0c80102570 2024-09-19T09:02:16.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.524+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c8010a0a0 con 0x7f0c80102570 2024-09-19T09:02:16.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.525+0000 7f0c7d7fa640 1 -- 172.21.15.83:0/1653255003 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f0c680bc5c0 con 0x7f0c80102570 2024-09-19T09:02:16.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:16.525 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"btime":"2024-09-19T09:01:17:195983+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:01:16.785988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[14583,24476,24430,24443,24445]},"id":1}]} 2024-09-19T09:02:16.525 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0c6c0a32d0 msgr2=0x7f0c6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0c6c0a32d0 0x7f0c6c0a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005e10 tx=0x7f0c70005da0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 msgr2=0x7f0c800fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c800fd1c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0c68006010 tx=0x7f0c680042f0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 shutdown_connections 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f0c6c0a32d0 0x7f0c6c0a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c80102ef0 0x7f0c800fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c80102570 0x7f0c800fd1c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 --2- 172.21.15.83:0/1653255003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c80100e20 0x7f0c800fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 >> 172.21.15.83:0/1653255003 conn(0x7f0c800fc7d0 msgr2=0x7f0c8006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 shutdown_connections 2024-09-19T09:02:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:16.527+0000 7f0c85b61640 1 -- 172.21.15.83:0/1653255003 wait complete. 2024-09-19T09:02:16.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:16 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1653255003' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:16.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:16 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1653255003' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:16.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:16 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1653255003' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:17.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:17.478 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:17.879 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:17 smithi083 ceph-mon[30926]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:17.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:17 smithi184 ceph-mon[35007]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:17.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:17 smithi122 ceph-mon[34247]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:17.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 -- 172.21.15.83:0/2661593950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 msgr2=0x7f3dac107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 --2- 172.21.15.83:0/2661593950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac107b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009930 tx=0x7f3d9402a420 comp rx=0 tx=0).stop 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 -- 172.21.15.83:0/2661593950 shutdown_connections 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 --2- 172.21.15.83:0/2661593950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac1082a0 0x7f3dac10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 --2- 172.21.15.83:0/2661593950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac107b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 --2- 172.21.15.83:0/2661593950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac102d30 0x7f3dac103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 -- 172.21.15.83:0/2661593950 >> 172.21.15.83:0/2661593950 conn(0x7f3dac0fc7d0 msgr2=0x7f3dac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 -- 172.21.15.83:0/2661593950 shutdown_connections 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 -- 172.21.15.83:0/2661593950 wait complete. 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 Processor -- start 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.959+0000 7f3db1a50640 1 -- start start 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac102d30 0x7f3dac198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac1082a0 0x7f3dac19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac111f90 con 0x7f3dac1036e0 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac111e10 con 0x7f3dac1082a0 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac112110 con 0x7f3dac102d30 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46980/0 (socket says 172.21.15.83:46980) 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 -- 172.21.15.83:0/3454161364 learned_addr learned my addr 172.21.15.83:0/3454161364 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daaffd640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac102d30 0x7f3dac198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac1082a0 0x7f3dac19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 -- 172.21.15.83:0/3454161364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac102d30 msgr2=0x7f3dac198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac102d30 0x7f3dac198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 -- 172.21.15.83:0/3454161364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac1082a0 msgr2=0x7f3dac19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac1082a0 0x7f3dac19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 -- 172.21.15.83:0/3454161364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac19d500 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac1082a0 0x7f3dac19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3daa7fc640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac198a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d94031440 tx=0x7f3d94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9403f030 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d94003aa0 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.960+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac19d790 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.961+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94035070 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.961+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a50d0 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.962+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac103110 con 0x7f3dac1036e0 2024-09-19T09:02:17.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.963+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3d94042030 con 0x7f3dac1036e0 2024-09-19T09:02:17.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.964+0000 7f3db0a4e640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3d980a3350 0x7f3d980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.964+0000 7f3daaffd640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3d980a3350 0x7f3d980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.964+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3d940f0890 con 0x7f3dac1036e0 2024-09-19T09:02:17.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.964+0000 7f3daaffd640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3d980a3350 0x7f3d980a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00a400 tx=0x7f3d9c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:17.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:17.966+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d940bd0f0 con 0x7f3dac1036e0 2024-09-19T09:02:18.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.136+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3dac10a2b0 con 0x7f3dac1036e0 2024-09-19T09:02:18.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.137+0000 7f3db0a4e640 1 -- 172.21.15.83:0/3454161364 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24765 (secure 0 0 0) 0x7f3d940bc9f0 con 0x7f3dac1036e0 2024-09-19T09:02:18.138 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:18.138 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":89,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:01:44.991185+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3d980a3350 msgr2=0x7f3d980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3d980a3350 0x7f3d980a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00a400 tx=0x7f3d9c00d040 comp rx=0 tx=0).stop 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 msgr2=0x7f3dac198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac198a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d94031440 tx=0x7f3d94004270 comp rx=0 tx=0).stop 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 shutdown_connections 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f3d980a3350 0x7f3d980a5810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dac1082a0 0x7f3dac19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1036e0 0x7f3dac198a90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 --2- 172.21.15.83:0/3454161364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac102d30 0x7f3dac198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 >> 172.21.15.83:0/3454161364 conn(0x7f3dac0fc7d0 msgr2=0x7f3dac105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 shutdown_connections 2024-09-19T09:02:18.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:18.139+0000 7f3db1a50640 1 -- 172.21.15.83:0/3454161364 wait complete. 2024-09-19T09:02:18.885 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:18 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3454161364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:18.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:18 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3454161364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:18.914 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:18.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:18 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3454161364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:19.162 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:19.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2296839317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 msgr2=0x7f5f5410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2296839317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f5410ec70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009930 tx=0x7f5f4c02a440 comp rx=0 tx=0).stop 2024-09-19T09:02:19.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2296839317 shutdown_connections 2024-09-19T09:02:19.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2296839317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f5410ec70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2296839317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103780 0x7f5f54107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2296839317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54102dd0 0x7f5f541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2296839317 >> 172.21.15.83:0/2296839317 conn(0x7f5f540fc7d0 msgr2=0x7f5f540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2296839317 shutdown_connections 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2296839317 wait complete. 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 Processor -- start 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.627+0000 7f5f5b3b4640 1 -- start start 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54102dd0 0x7f5f54100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103780 0x7f5f54100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f541014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54111fc0 con 0x7f5f54108300 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54111e40 con 0x7f5f54103780 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54112140 con 0x7f5f54102dd0 2024-09-19T09:02:19.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f541014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f541014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46992/0 (socket says 172.21.15.83:46992) 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 -- 172.21.15.83:0/2079565060 learned_addr learned my addr 172.21.15.83:0/2079565060 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59150640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54102dd0 0x7f5f54100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5894f640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103780 0x7f5f54100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 -- 172.21.15.83:0/2079565060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54102dd0 msgr2=0x7f5f54100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54102dd0 0x7f5f54100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 -- 172.21.15.83:0/2079565060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103780 msgr2=0x7f5f54100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103780 0x7f5f54100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 -- 172.21.15.83:0/2079565060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f541a69c0 con 0x7f5f54108300 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f59951640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f541014b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c005940 tx=0x7f5f4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c03f030 con 0x7f5f54108300 2024-09-19T09:02:19.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f4c003aa0 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f541a6c50 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.628+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c035070 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.629+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f541a7180 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.630+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f541031b0 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.631+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f4c042030 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.632+0000 7f5f527fc640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5f3c0a3350 0x7f5f3c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.632+0000 7f5f59150640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5f3c0a3350 0x7f5f3c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.632+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5f4c0f0920 con 0x7f5f54108300 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.633+0000 7f5f59150640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5f3c0a3350 0x7f5f3c0a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005fd0 tx=0x7f5f44009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:19.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.635+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f4c0bd180 con 0x7f5f54108300 2024-09-19T09:02:19.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.835+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f5410a290 con 0x7f5f54108300 2024-09-19T09:02:19.836 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:19 smithi083 ceph-mon[30926]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:19.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.835+0000 7f5f527fc640 1 -- 172.21.15.83:0/2079565060 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f5f4c0bca80 con 0x7f5f54108300 2024-09-19T09:02:19.837 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:19.837 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"btime":"2024-09-19T09:01:17:195983+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:01:16.785988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[14583,24476,24430,24443,24445]},"id":1}]} 2024-09-19T09:02:19.838 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:02:19.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.837+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5f3c0a3350 msgr2=0x7f5f3c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.837+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5f3c0a3350 0x7f5f3c0a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005fd0 tx=0x7f5f44009680 comp rx=0 tx=0).stop 2024-09-19T09:02:19.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.837+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 msgr2=0x7f5f541014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.837+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f541014b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c005940 tx=0x7f5f4c004270 comp rx=0 tx=0).stop 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 shutdown_connections 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5f3c0a3350 0x7f5f3c0a5810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f54108300 0x7f5f541014b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103780 0x7f5f54100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 --2- 172.21.15.83:0/2079565060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54102dd0 0x7f5f54100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 >> 172.21.15.83:0/2079565060 conn(0x7f5f540fc7d0 msgr2=0x7f5f54105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 shutdown_connections 2024-09-19T09:02:19.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:19.838+0000 7f5f5b3b4640 1 -- 172.21.15.83:0/2079565060 wait complete. 2024-09-19T09:02:19.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:19 smithi184 ceph-mon[35007]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:19.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:19 smithi122 ceph-mon[34247]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:20.666 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:00:37.699557+0000', 'modified': '2024-09-19T09:01:16.785988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24445, 'mds_2': 24443, 'mds_3': 24430, 'mds_4': 14583}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.83:6839/37046716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6838', 'nonce': 37046716}, {'type': 'v1', 'addr': '172.21.15.83:6839', 'nonce': 37046716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14583': {'gid': 14583, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.83:6841/2224605516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6840', 'nonce': 2224605516}, {'type': 'v1', 'addr': '172.21.15.83:6841', 'nonce': 2224605516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/3460261556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 3460261556}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 3460261556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/2584272411', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 2584272411}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 2584272411}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6835/2324915489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2324915489}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 2324915489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/1361922279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 1361922279}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 1361922279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.184:6837/236760278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 236760278}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 236760278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.122:6837/3109792741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 3109792741}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3109792741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.184:6839/1323973245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 1323973245}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 1323973245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.122:6839/1686011933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 1686011933}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 1686011933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [14583, 24476, 24430, 24443, 24445]} 2024-09-19T09:02:20.666 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:02:20.667 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T09:02:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:20 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2079565060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:20.914 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:20.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:20 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2079565060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:20.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:20 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2079565060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:21.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 -- 172.21.15.83:0/1266194532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 msgr2=0x7f73dc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 --2- 172.21.15.83:0/1266194532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc1029b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009900 tx=0x7f73d002a480 comp rx=0 tx=0).stop 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 -- 172.21.15.83:0/1266194532 shutdown_connections 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 --2- 172.21.15.83:0/1266194532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73dc102ef0 0x7f73dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 --2- 172.21.15.83:0/1266194532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc1029b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 --2- 172.21.15.83:0/1266194532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73dc100e20 0x7f73dc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 -- 172.21.15.83:0/1266194532 >> 172.21.15.83:0/1266194532 conn(0x7f73dc0fc7d0 msgr2=0x7f73dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.444+0000 7f73e1d99640 1 -- 172.21.15.83:0/1266194532 shutdown_connections 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.445+0000 7f73e1d99640 1 -- 172.21.15.83:0/1266194532 wait complete. 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.445+0000 7f73e1d99640 1 Processor -- start 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.445+0000 7f73e1d99640 1 -- start start 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73dc100e20 0x7f73dc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73dc102ef0 0x7f73dc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc110e30 con 0x7f73dc102570 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc110cb0 con 0x7f73dc102ef0 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc110fb0 con 0x7f73dc100e20 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33426/0 (socket says 172.21.15.83:33426) 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 -- 172.21.15.83:0/2103664000 learned_addr learned my addr 172.21.15.83:0/2103664000 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73db7fe640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73dc100e20 0x7f73dc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73dbfff640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73dc102ef0 0x7f73dc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 -- 172.21.15.83:0/2103664000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73dc100e20 msgr2=0x7f73dc198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73dc100e20 0x7f73dc198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 -- 172.21.15.83:0/2103664000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73dc102ef0 msgr2=0x7f73dc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73dc102ef0 0x7f73dc19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 -- 172.21.15.83:0/2103664000 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc19d3c0 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73daffd640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc198950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f73d0006010 tx=0x7f73d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73d8ff9640 1 -- 172.21.15.83:0/2103664000 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d003f030 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73d8ff9640 1 -- 172.21.15.83:0/2103664000 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73d0003cb0 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73d8ff9640 1 -- 172.21.15.83:0/2103664000 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0035070 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.446+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73dc19d650 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.447+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73dc1a4f90 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73d8ff9640 1 -- 172.21.15.83:0/2103664000 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f73d0042030 con 0x7f73dc102570 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 Processor -- start 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 -- start start 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6478b0 0x55654c647c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c656a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c6593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55654c5ae090 con 0x55654c6481d0 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55654c555a70 con 0x55654c656fc0 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.449+0000 7f73e4172740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55654c5aa050 con 0x55654c6478b0 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c656a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6478b0 0x55654c647c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c656a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33428/0 (socket says 172.21.15.83:33428) 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 -- 172.21.15.83:0/2133454554 learned_addr learned my addr 172.21.15.83:0/2133454554 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73daffd640 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c6593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73d8ff9640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f73c40a3350 0x7f73c40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 -- 172.21.15.83:0/2133454554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6478b0 msgr2=0x55654c647c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6478b0 0x55654c647c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 -- 172.21.15.83:0/2133454554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 msgr2=0x55654c6593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c6593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 -- 172.21.15.83:0/2133454554 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654c562130 con 0x55654c6481d0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73dbfff640 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6478b0 0x55654c647c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73dbfff640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f73c40a3350 0x7f73c40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73d8ff9640 1 -- 172.21.15.83:0/2103664000 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f73d00f02c0 con 0x7f73dc102570 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73db7fe640 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c656a80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00bd50 tx=0x7f73cc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977c9d8b0ea6121c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73dbfff640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f73c40a3350 0x7f73c40a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f73d4005fd0 tx=0x7f73d4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73c1ffb640 1 -- 172.21.15.83:0/2133454554 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc005220 con 0x55654c6481d0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73c1ffb640 1 -- 172.21.15.83:0/2133454554 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73cc00be40 con 0x55654c6481d0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.450+0000 7f73c1ffb640 1 -- 172.21.15.83:0/2133454554 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc011760 con 0x55654c6481d0 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 -- 172.21.15.83:0/2133454554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 msgr2=0x55654c656a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c656a80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00bd50 tx=0x7f73cc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 -- 172.21.15.83:0/2133454554 shutdown_connections 2024-09-19T09:02:21.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c6593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c656a80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 --2- 172.21.15.83:0/2133454554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6478b0 0x55654c647c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 -- 172.21.15.83:0/2133454554 >> 172.21.15.83:0/2133454554 conn(0x55654c643f60 msgr2=0x55654c644340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 -- 172.21.15.83:0/2133454554 shutdown_connections 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.451+0000 7f73e4172740 1 -- 172.21.15.83:0/2133454554 wait complete. 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 -- start start 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 Processor -- start 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c656860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6481d0 0x55654c653bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c6540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55654c659b90 con 0x55654c6478b0 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55654c568f20 con 0x55654c6481d0 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55654c659d10 con 0x55654c656fc0 2024-09-19T09:02:21.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73e4172740 10 client.0 _ll_register_callbacks cb 0x55654c532030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c656860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c656860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33440/0 (socket says 172.21.15.83:33440) 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 -- 172.21.15.83:0/182871992 learned_addr learned my addr 172.21.15.83:0/182871992 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73daffd640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6481d0 0x55654c653bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73dbfff640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c6540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 -- 172.21.15.83:0/182871992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 msgr2=0x55654c6540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c6540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 -- 172.21.15.83:0/182871992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6481d0 msgr2=0x55654c653bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.452+0000 7f73db7fe640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6481d0 0x55654c653bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73db7fe640 1 -- 172.21.15.83:0/182871992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654c31f2b0 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73db7fe640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c656860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00bd20 tx=0x7f73cc011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6008cf8cc4c28edd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73baffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73baffd640 1 -- 172.21.15.83:0/182871992 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc011b70 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73baffd640 1 -- 172.21.15.83:0/182871992 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f73cc011d10 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55654c5bb600 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73baffd640 1 -- 172.21.15.83:0/182871992 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73cc004020 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73e4172740 10 client.15036 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55654c6654f0 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73baffd640 1 -- 172.21.15.83:0/182871992 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55654c5bb600 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73baffd640 1 -- 172.21.15.83:0/182871992 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f73cc003cd0 con 0x55654c6478b0 2024-09-19T09:02:21.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73e4172740 10 client.15036 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.453+0000 7f73e4172740 10 client.15036 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73e4172740 20 client.15036 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73e4172740 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c667740 0x55654c668bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73e4172740 4 client.15036 mds_command: new command op to 14583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 --> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55654c5b5b10 con 0x55654c667740 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73daffd640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c667740 0x55654c668bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73baffd640 10 client.15036 ms_handle_connect on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.454+0000 7f73daffd640 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c667740 0x55654c668bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e4ee8729bc210b75 server_cookie=86dfab03f12cd10c in_seq=0 out_seq=0 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73baffd640 1 -- 172.21.15.83:0/182871992 <== mds.4 v2:172.21.15.83:6840/2224605516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55654c5b5b10 con 0x55654c667740 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73baffd640 10 client.15036 handle_command_reply: tid=0 2024-09-19T09:02:21.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 client.15036 shutdown 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 msgr2=0x55654c656860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c656860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00bd20 tx=0x7f73cc011770 comp rx=0 tx=0).stop 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 shutdown_connections 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c6540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c667740 0x55654c668bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6481d0 0x55654c653bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 --2- 172.21.15.83:0/182871992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c656860 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 >> 172.21.15.83:0/182871992 conn(0x55654c643f60 msgr2=0x55654c649cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73baffd640 0 client.15036 ms_handle_reset on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:21.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 shutdown_connections 2024-09-19T09:02:21.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 1 -- 172.21.15.83:0/182871992 wait complete. 2024-09-19T09:02:21.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.455+0000 7f73e4172740 20 client.15036 trim_cache size 0 max 16384 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.473+0000 7f73e4172740 1 Processor -- start 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.473+0000 7f73e4172740 1 -- start start 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73e4172740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6478b0 0x55654c668bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73e4172740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c650e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73e4172740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c651350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73e4172740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55654c666ef0 con 0x55654c6481d0 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73e4172740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55654c6675c0 con 0x55654c6478b0 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73e4172740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55654c667c90 con 0x55654c656fc0 2024-09-19T09:02:21.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c650e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c650e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33450/0 (socket says 172.21.15.83:33450) 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 -- 172.21.15.83:0/2461811443 learned_addr learned my addr 172.21.15.83:0/2461811443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73db7fe640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6478b0 0x55654c668bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73dbfff640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c651350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 -- 172.21.15.83:0/2461811443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 msgr2=0x55654c651350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c651350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 -- 172.21.15.83:0/2461811443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6478b0 msgr2=0x55654c668bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6478b0 0x55654c668bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 -- 172.21.15.83:0/2461811443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654c648000 con 0x55654c6481d0 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73dbfff640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c651350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73db7fe640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6478b0 0x55654c668bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.474+0000 7f73daffd640 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c650e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f73d00bc0c0 tx=0x7f73d00f2710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab212bf1714368d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73c17fa640 1 -- 172.21.15.83:0/2461811443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0049040 con 0x55654c6481d0 2024-09-19T09:02:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73c17fa640 1 -- 172.21.15.83:0/2461811443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73d00bcac0 con 0x55654c6481d0 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73c17fa640 1 -- 172.21.15.83:0/2461811443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d00c0770 con 0x55654c6481d0 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 -- 172.21.15.83:0/2461811443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 msgr2=0x55654c650e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c650e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f73d00bc0c0 tx=0x7f73d00f2710 comp rx=0 tx=0).stop 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 -- 172.21.15.83:0/2461811443 shutdown_connections 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c656fc0 0x55654c651350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6481d0 0x55654c650e10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 --2- 172.21.15.83:0/2461811443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c6478b0 0x55654c668bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 -- 172.21.15.83:0/2461811443 >> 172.21.15.83:0/2461811443 conn(0x55654c643f60 msgr2=0x55654c64f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 -- 172.21.15.83:0/2461811443 shutdown_connections 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.475+0000 7f73e4172740 1 -- 172.21.15.83:0/2461811443 wait complete. 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 -- start start 2024-09-19T09:02:21.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 Processor -- start 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c66fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6481d0 0x55654c670310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c670c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55654c668a30 con 0x55654c6478b0 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55654c668360 con 0x55654c656fc0 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55654c669100 con 0x55654c6481d0 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73e4172740 10 client.0 _ll_register_callbacks cb 0x7f73d00f3c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c66fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c66fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33464/0 (socket says 172.21.15.83:33464) 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.476+0000 7f73db7fe640 1 -- 172.21.15.83:0/81180782 learned_addr learned my addr 172.21.15.83:0/81180782 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73dbfff640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c670c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73db7fe640 1 -- 172.21.15.83:0/81180782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6481d0 msgr2=0x55654c670310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73daffd640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6481d0 0x55654c670310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73db7fe640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6481d0 0x55654c670310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73db7fe640 1 -- 172.21.15.83:0/81180782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 msgr2=0x55654c670c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73db7fe640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c670c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73db7fe640 1 -- 172.21.15.83:0/81180782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654c671300 con 0x55654c6478b0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73dbfff640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c670c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73db7fe640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c66fdd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0265b0 tx=0x7f73cc0117e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e26b996682affc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73baffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73baffd640 1 -- 172.21.15.83:0/81180782 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc039060 con 0x55654c6478b0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73baffd640 1 -- 172.21.15.83:0/81180782 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f73cc011d80 con 0x55654c6478b0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73d00bcac0 con 0x55654c6478b0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73baffd640 1 -- 172.21.15.83:0/81180782 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73cc00b520 con 0x55654c6478b0 2024-09-19T09:02:21.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73e4172740 10 client.15042 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55654c66f260 con 0x55654c6478b0 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73baffd640 1 -- 172.21.15.83:0/81180782 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73d00bcac0 con 0x55654c6478b0 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.477+0000 7f73baffd640 1 -- 172.21.15.83:0/81180782 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f73cc0039d0 con 0x55654c6478b0 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 10 client.15042 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 10 client.15042 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 20 client.15042 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c6d66d0 0x55654c6d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 4 client.15042 mds_command: new command op to 14583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 --> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] -- command(tid 0: {"prefix": "status"}) -- 0x55654c5320e0 con 0x55654c6d66d0 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73daffd640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c6d66d0 0x55654c6d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73daffd640 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c6d66d0 0x55654c6d53e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ac5f36788c682655 server_cookie=d2c6cd8328a4d98f in_seq=0 out_seq=0 2024-09-19T09:02:21.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73baffd640 10 client.15042 ms_handle_connect on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:21.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73baffd640 1 -- 172.21.15.83:0/81180782 <== mds.4 v2:172.21.15.83:6840/2224605516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55654c5320e0 con 0x55654c6d66d0 2024-09-19T09:02:21.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73baffd640 10 client.15042 handle_command_reply: tid=0 2024-09-19T09:02:21.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 client.15042 shutdown 2024-09-19T09:02:21.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 msgr2=0x55654c66fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c66fdd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0265b0 tx=0x7f73cc0117e0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 shutdown_connections 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55654c6d66d0 0x55654c6d53e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55654c656fc0 0x55654c670c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55654c6481d0 0x55654c670310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 --2- 172.21.15.83:0/81180782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55654c6478b0 0x55654c66fdd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 >> 172.21.15.83:0/81180782 conn(0x55654c643f60 msgr2=0x55654c6427e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.478+0000 7f73baffd640 0 client.15042 ms_handle_reset on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 shutdown_connections 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e4172740 1 -- 172.21.15.83:0/81180782 wait complete. 2024-09-19T09:02:21.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e4172740 20 client.15042 trim_cache size 0 max 16384 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 4, 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 14583, 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 66.290403001000001, 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 116.749698192 2024-09-19T09:02:21.491 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:21.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f73c40a3350 msgr2=0x7f73c40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f73c40a3350 0x7f73c40a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f73d4005fd0 tx=0x7f73d4004a40 comp rx=0 tx=0).stop 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 msgr2=0x7f73dc198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc198950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f73d0006010 tx=0x7f73d00042f0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 shutdown_connections 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f73c40a3350 0x7f73c40a5810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73dc102ef0 0x7f73dc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73dc102570 0x7f73dc198950 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 --2- 172.21.15.83:0/2103664000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73dc100e20 0x7f73dc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.479+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 >> 172.21.15.83:0/2103664000 conn(0x7f73dc0fc7d0 msgr2=0x7f73dc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.480+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 shutdown_connections 2024-09-19T09:02:21.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:21.480+0000 7f73e1d99640 1 -- 172.21.15.83:0/2103664000 wait complete. 2024-09-19T09:02:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:21 smithi083 ceph-mon[30926]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:21.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:21 smithi184 ceph-mon[35007]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:21.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:21 smithi122 ceph-mon[34247]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:22.300 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:02:22.545 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 -- 172.21.15.83:0/2745763584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 msgr2=0x7f49d810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 --2- 172.21.15.83:0/2745763584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d810eaa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009ca0 tx=0x7f49d002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 -- 172.21.15.83:0/2745763584 shutdown_connections 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 --2- 172.21.15.83:0/2745763584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d810eaa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 --2- 172.21.15.83:0/2745763584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 0x7f49d81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 --2- 172.21.15.83:0/2745763584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d8101df0 0x7f49d81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 -- 172.21.15.83:0/2745763584 >> 172.21.15.83:0/2745763584 conn(0x7f49d80fd8f0 msgr2=0x7f49d80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 -- 172.21.15.83:0/2745763584 shutdown_connections 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.973+0000 7f49ddefa640 1 -- 172.21.15.83:0/2745763584 wait complete. 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.974+0000 7f49ddefa640 1 Processor -- start 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.974+0000 7f49ddefa640 1 -- start start 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.974+0000 7f49ddefa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d8101df0 0x7f49d8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 0x7f49d81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8111e50 con 0x7f49d8106f20 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8111cd0 con 0x7f49d8101df0 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8111fd0 con 0x7f49d81027a0 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33476/0 (socket says 172.21.15.83:33476) 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 -- 172.21.15.83:0/3156852567 learned_addr learned my addr 172.21.15.83:0/3156852567 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d77fe640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d8101df0 0x7f49d8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 0x7f49d81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 -- 172.21.15.83:0/3156852567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 msgr2=0x7f49d81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 0x7f49d81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 -- 172.21.15.83:0/3156852567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d8101df0 msgr2=0x7f49d8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d8101df0 0x7f49d8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 -- 172.21.15.83:0/3156852567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d819d340 con 0x7f49d8106f20 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 0x7f49d81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d7fff640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d819cc60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009dc0 tx=0x7f49d0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d57fa640 1 -- 172.21.15.83:0/3156852567 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0004040 con 0x7f49d8106f20 2024-09-19T09:02:22.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d57fa640 1 -- 172.21.15.83:0/3156852567 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49d0004690 con 0x7f49d8106f20 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d819d5d0 con 0x7f49d8106f20 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49d57fa640 1 -- 172.21.15.83:0/3156852567 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0030d90 con 0x7f49d8106f20 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.975+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81a4f10 con 0x7f49d8106f20 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.978+0000 7f49d57fa640 1 -- 172.21.15.83:0/3156852567 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f49d00305c0 con 0x7f49d8106f20 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.978+0000 7f49e02d3740 1 Processor -- start 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.978+0000 7f49e02d3740 1 -- start start 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d57fa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f49c40a32d0 0x7f49c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e28db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e33670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f49c40a32d0 0x7f49c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 0x555880e35fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49e02d3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555880d8f090 con 0x555880e33bb0 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49e02d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555880d36a70 con 0x555880e292f0 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49e02d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555880d8b050 con 0x555880e289d0 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d57fa640 1 -- 172.21.15.83:0/3156852567 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f49d00f14c0 con 0x7f49d8106f20 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 0x555880e35fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 0x555880e35fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33488/0 (socket says 172.21.15.83:33488) 2024-09-19T09:02:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 -- 172.21.15.83:0/185077293 learned_addr learned my addr 172.21.15.83:0/185077293 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d77fe640 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e28db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49ceffd640 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e33670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 -- 172.21.15.83:0/185077293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 msgr2=0x555880e28db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e28db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 -- 172.21.15.83:0/185077293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 msgr2=0x555880e33670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e33670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 -- 172.21.15.83:0/185077293 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555880d43130 con 0x555880e33bb0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f49c40a32d0 0x7f49c40a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49d80ffe10 tx=0x7f49c0009d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49d7fff640 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 0x555880e35fa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f49d002f3b0 tx=0x7f49d002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970ce6b4c3cbb5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49cdffb640 1 -- 172.21.15.83:0/185077293 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00c1ae0 con 0x555880e33bb0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.979+0000 7f49cdffb640 1 -- 172.21.15.83:0/185077293 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49d0036070 con 0x555880e33bb0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49cdffb640 1 -- 172.21.15.83:0/185077293 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00b9da0 con 0x555880e33bb0 2024-09-19T09:02:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 -- 172.21.15.83:0/185077293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 msgr2=0x555880e35fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 0x555880e35fa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f49d002f3b0 tx=0x7f49d002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 -- 172.21.15.83:0/185077293 shutdown_connections 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e33bb0 0x555880e35fa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e33670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 --2- 172.21.15.83:0/185077293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e28db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 -- 172.21.15.83:0/185077293 >> 172.21.15.83:0/185077293 conn(0x555880e24f60 msgr2=0x555880e25340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 -- 172.21.15.83:0/185077293 shutdown_connections 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.980+0000 7f49e02d3740 1 -- 172.21.15.83:0/185077293 wait complete. 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 -- start start 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 Processor -- start 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e292f0 0x555880e30730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e30c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555880d8f090 con 0x555880e289d0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555880d49f20 con 0x555880e33bb0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555880e36540 con 0x555880e292f0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49e02d3740 10 client.0 _ll_register_callbacks cb 0x555880d13030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e333e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33494/0 (socket says 172.21.15.83:33494) 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 -- 172.21.15.83:0/2801236670 learned_addr learned my addr 172.21.15.83:0/2801236670 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d7fff640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e30c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49ceffd640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e292f0 0x555880e30730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 -- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e292f0 msgr2=0x555880e30730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e292f0 0x555880e30730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 -- 172.21.15.83:0/2801236670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 msgr2=0x555880e30c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e30c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d77fe640 1 -- 172.21.15.83:0/2801236670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555880b002b0 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.981+0000 7f49d7fff640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e30c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49d77fe640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e333e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f49c8010a50 tx=0x7f49c8010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b8aef660ee80d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49b6ffd640 1 -- 172.21.15.83:0/2801236670 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c801e060 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49b6ffd640 1 -- 172.21.15.83:0/2801236670 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f49c800fbd0 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d0036070 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49b6ffd640 1 -- 172.21.15.83:0/2801236670 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f49c8025050 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 10 client.15054 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555880e41c40 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49b6ffd640 1 -- 172.21.15.83:0/2801236670 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49d0036070 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49b6ffd640 1 -- 172.21.15.83:0/2801236670 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f49c8018370 con 0x555880e289d0 2024-09-19T09:02:22.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 10 client.15054 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 10 client.15054 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 20 client.15054 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880e442f0 0x555880e45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 4 client.15054 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.982+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 --> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555880d9c600 con 0x555880e442f0 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.983+0000 7f49ceffd640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880e442f0 0x555880e45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.983+0000 7f49b6ffd640 10 client.15054 ms_handle_connect on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.983+0000 7f49ceffd640 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880e442f0 0x555880e45760 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fcf25b30a2bc44c3 server_cookie=fe98c85646b203cb in_seq=0 out_seq=0 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49b6ffd640 1 -- 172.21.15.83:0/2801236670 <== mds.3 v2:172.21.15.184:6836/236760278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555880d9c600 con 0x555880e442f0 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49b6ffd640 10 client.15054 handle_command_reply: tid=0 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 client.15054 shutdown 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 msgr2=0x555880e333e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e333e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f49c8010a50 tx=0x7f49c8010f10 comp rx=0 tx=0).stop 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 shutdown_connections 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880e442f0 0x555880e45760 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e30c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49b6ffd640 0 client.15054 ms_handle_reset on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e292f0 0x555880e30730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 --2- 172.21.15.83:0/2801236670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e333e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 >> 172.21.15.83:0/2801236670 conn(0x555880e24f60 msgr2=0x555880e2ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 shutdown_connections 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 1 -- 172.21.15.83:0/2801236670 wait complete. 2024-09-19T09:02:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:22.984+0000 7f49e02d3740 20 client.15054 trim_cache size 0 max 16384 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 Processor -- start 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 -- start start 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 0x555880e1fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e2bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555880e43aa0 con 0x555880e292f0 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555880e44170 con 0x555880e33bb0 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49e02d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555880e44840 con 0x555880e289d0 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 0x555880e1fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 0x555880e1fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33498/0 (socket says 172.21.15.83:33498) 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 -- 172.21.15.83:0/3043979 learned_addr learned my addr 172.21.15.83:0/3043979 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49d7fff640 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e2bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 -- 172.21.15.83:0/3043979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 msgr2=0x555880e45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 -- 172.21.15.83:0/3043979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 msgr2=0x555880e2bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e2bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49ceffd640 1 -- 172.21.15.83:0/3043979 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555880e2f6e0 con 0x555880e292f0 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.002+0000 7f49d7fff640 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e2bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49ceffd640 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 0x555880e1fce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x555880e2ffc0 tx=0x7f49c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfad3b362d63251f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49cd7fa640 1 -- 172.21.15.83:0/3043979 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0030070 con 0x555880e292f0 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49cd7fa640 1 -- 172.21.15.83:0/3043979 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49c002b460 con 0x555880e292f0 2024-09-19T09:02:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49cd7fa640 1 -- 172.21.15.83:0/3043979 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00236a0 con 0x555880e292f0 2024-09-19T09:02:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49e02d3740 1 -- 172.21.15.83:0/3043979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 msgr2=0x555880e1fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49e02d3740 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 0x555880e1fce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x555880e2ffc0 tx=0x7f49c0018000 comp rx=0 tx=0).stop 2024-09-19T09:02:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49e02d3740 1 -- 172.21.15.83:0/3043979 shutdown_connections 2024-09-19T09:02:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49e02d3740 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e33bb0 0x555880e2bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49e02d3740 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e292f0 0x555880e1fce0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.003+0000 7f49e02d3740 1 --2- 172.21.15.83:0/3043979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e289d0 0x555880e45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- 172.21.15.83:0/3043979 >> 172.21.15.83:0/3043979 conn(0x555880e24f60 msgr2=0x555880e2b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- 172.21.15.83:0/3043979 shutdown_connections 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- 172.21.15.83:0/3043979 wait complete. 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- start start 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 Processor -- start 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e4df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e47310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e33bb0 0x555880e47850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555880e455e0 con 0x555880e289d0 2024-09-19T09:02:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555880e44f10 con 0x555880e292f0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.004+0000 7f49e02d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555880e45cb0 con 0x555880e33bb0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49e02d3740 10 client.0 _ll_register_callbacks cb 0x7f49c800a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e4df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e4df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33504/0 (socket says 172.21.15.83:33504) 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 -- 172.21.15.83:0/4102081877 learned_addr learned my addr 172.21.15.83:0/4102081877 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49ceffd640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e47310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d7fff640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e33bb0 0x555880e47850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 -- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e33bb0 msgr2=0x555880e47850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e33bb0 0x555880e47850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 -- 172.21.15.83:0/4102081877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 msgr2=0x555880e47310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e47310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 -- 172.21.15.83:0/4102081877 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555880e47e10 con 0x555880e289d0 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49ceffd640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e47310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:23.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49d77fe640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e4df40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f49c8010a20 tx=0x7f49c80106d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e916e106166b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49b6ffd640 1 -- 172.21.15.83:0/4102081877 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8018980 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c002b460 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49b6ffd640 1 -- 172.21.15.83:0/4102081877 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f49c8018b20 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49b6ffd640 1 -- 172.21.15.83:0/4102081877 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f49c801e020 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49e02d3740 10 client.15060 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.005+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555880e4c7a0 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49b6ffd640 1 -- 172.21.15.83:0/4102081877 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49c002b460 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49b6ffd640 1 -- 172.21.15.83:0/4102081877 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f49c8029be0 con 0x555880e289d0 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49e02d3740 10 client.15060 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49e02d3740 10 client.15060 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49e02d3740 20 client.15060 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49e02d3740 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880eb32f0 0x555880eb2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49e02d3740 4 client.15060 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 --> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] -- command(tid 0: {"prefix": "status"}) -- 0x555880d96b10 con 0x555880eb32f0 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49ceffd640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880eb32f0 0x555880eb2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49b6ffd640 10 client.15060 ms_handle_connect on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.006+0000 7f49ceffd640 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880eb32f0 0x555880eb2000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=41bbc78997645445 server_cookie=f0439276877ec257 in_seq=0 out_seq=0 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49b6ffd640 1 -- 172.21.15.83:0/4102081877 <== mds.3 v2:172.21.15.184:6836/236760278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555880d96b10 con 0x555880eb32f0 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49b6ffd640 10 client.15060 handle_command_reply: tid=0 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 client.15060 shutdown 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 msgr2=0x555880e4df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e4df40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f49c8010a20 tx=0x7f49c80106d0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 shutdown_connections 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x555880eb32f0 0x555880eb2000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555880e33bb0 0x555880e47850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555880e292f0 0x555880e47310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 --2- 172.21.15.83:0/4102081877 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555880e289d0 0x555880e4df40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 >> 172.21.15.83:0/4102081877 conn(0x555880e24f60 msgr2=0x555880e2bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49b6ffd640 0 client.15060 ms_handle_reset on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 shutdown_connections 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 1 -- 172.21.15.83:0/4102081877 wait complete. 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.007+0000 7f49e02d3740 20 client.15060 trim_cache size 0 max 16384 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 3, 2024-09-19T09:02:23.013 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24430, 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 67.984208914999996, 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 129.64705536299999 2024-09-19T09:02:23.014 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f49c40a32d0 msgr2=0x7f49c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f49c40a32d0 0x7f49c40a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49d80ffe10 tx=0x7f49c0009d30 comp rx=0 tx=0).stop 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 msgr2=0x7f49d819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d819cc60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009dc0 tx=0x7f49d0003ba0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 shutdown_connections 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f49c40a32d0 0x7f49c40a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49d8106f20 0x7f49d819cc60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49d81027a0 0x7f49d81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 --2- 172.21.15.83:0/3156852567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d8101df0 0x7f49d8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 >> 172.21.15.83:0/3156852567 conn(0x7f49d80fd8f0 msgr2=0x7f49d80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 shutdown_connections 2024-09-19T09:02:23.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:23.008+0000 7f49ddefa640 1 -- 172.21.15.83:0/3156852567 wait complete. 2024-09-19T09:02:23.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:02:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:23 smithi184 ceph-mon[35007]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:24.455 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:23 smithi083 ceph-mon[30926]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:24.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:23 smithi122 ceph-mon[34247]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:24.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 -- 172.21.15.83:0/3859542445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 msgr2=0x7f1868100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 --2- 172.21.15.83:0/3859542445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868100ed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1850009930 tx=0x7f185002a420 comp rx=0 tx=0).stop 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 -- 172.21.15.83:0/3859542445 shutdown_connections 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 --2- 172.21.15.83:0/3859542445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1868101410 0x7f186810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 --2- 172.21.15.83:0/3859542445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868100ed0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 --2- 172.21.15.83:0/3859542445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868106a70 0x7f1868106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 -- 172.21.15.83:0/3859542445 >> 172.21.15.83:0/3859542445 conn(0x7f18680fc790 msgr2=0x7f18680febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 -- 172.21.15.83:0/3859542445 shutdown_connections 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.675+0000 7f186dfd9640 1 -- 172.21.15.83:0/3859542445 wait complete. 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 Processor -- start 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 -- start start 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868101410 0x7f18681997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1868106a70 0x7f18681a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1868110d40 con 0x7f1868100a70 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1868110bc0 con 0x7f1868101410 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f186dfd9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1868110ec0 con 0x7f1868106a70 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33518/0 (socket says 172.21.15.83:33518) 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 -- 172.21.15.83:0/838364848 learned_addr learned my addr 172.21.15.83:0/838364848 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f185ffff640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868101410 0x7f18681997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f1867fff640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1868106a70 0x7f18681a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 -- 172.21.15.83:0/838364848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1868106a70 msgr2=0x7f18681a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1868106a70 0x7f18681a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 -- 172.21.15.83:0/838364848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868101410 msgr2=0x7f18681997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868101410 0x7f18681997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.676+0000 7f18677fe640 1 -- 172.21.15.83:0/838364848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18681a4850 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.677+0000 7f18677fe640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868199290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f185800d950 tx=0x7f185800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.677+0000 7f18657fa640 1 -- 172.21.15.83:0/838364848 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858017070 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.677+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18681a4a20 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.677+0000 7f18657fa640 1 -- 172.21.15.83:0/838364848 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1858009c30 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.677+0000 7f18657fa640 1 -- 172.21.15.83:0/838364848 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185800f620 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.677+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18681a4ee0 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.679+0000 7f18657fa640 1 -- 172.21.15.83:0/838364848 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f18580109a0 con 0x7f1868100a70 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.679+0000 7f18703b2740 1 Processor -- start 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.679+0000 7f18703b2740 1 -- start start 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18703b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d35cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18703b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d36ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18703b2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d36bfc0 0x562c1d36e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18703b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562c1d2c3090 con 0x562c1d35d1d0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18703b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562c1d26aa70 con 0x562c1d35c8b0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18703b2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c1d2bf050 con 0x562c1d36bfc0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18657fa640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f18540a32d0 0x7f18540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d36ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d36ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33534/0 (socket says 172.21.15.83:33534) 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 -- 172.21.15.83:0/3197363569 learned_addr learned my addr 172.21.15.83:0/3197363569 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f1867fff640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f18540a32d0 0x7f18540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f185ffff640 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d36bfc0 0x562c1d36e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f1867fff640 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d35cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18657fa640 1 -- 172.21.15.83:0/838364848 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f18580cfa50 con 0x7f1868100a70 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 -- 172.21.15.83:0/3197363569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d36bfc0 msgr2=0x562c1d36e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d36bfc0 0x562c1d36e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 -- 172.21.15.83:0/3197363569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 msgr2=0x562c1d35cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d35cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 -- 172.21.15.83:0/3197363569 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c1d277130 con 0x562c1d35d1d0 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f1867fff640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f18540a32d0 0x7f18540a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1860009fd0 tx=0x7f1860009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.680+0000 7f18677fe640 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d36ba80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1858021000 tx=0x7f185809b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66af03ffbda497ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f185dffb640 1 -- 172.21.15.83:0/3197363569 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858020070 con 0x562c1d35d1d0 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f185dffb640 1 -- 172.21.15.83:0/3197363569 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1858009de0 con 0x562c1d35d1d0 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f185dffb640 1 -- 172.21.15.83:0/3197363569 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18580860f0 con 0x562c1d35d1d0 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 -- 172.21.15.83:0/3197363569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 msgr2=0x562c1d36ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d36ba80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1858021000 tx=0x7f185809b770 comp rx=0 tx=0).stop 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 -- 172.21.15.83:0/3197363569 shutdown_connections 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d36bfc0 0x562c1d36e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d36ba80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 --2- 172.21.15.83:0/3197363569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d35cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 -- 172.21.15.83:0/3197363569 >> 172.21.15.83:0/3197363569 conn(0x562c1d358f60 msgr2=0x562c1d359340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 -- 172.21.15.83:0/3197363569 shutdown_connections 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.681+0000 7f18703b2740 1 -- 172.21.15.83:0/3197363569 wait complete. 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 -- start start 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 Processor -- start 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 0x562c1d36b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d368c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d369150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562c1d36eb30 con 0x562c1d35c8b0 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562c1d27df20 con 0x562c1d36bfc0 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c1d36ecb0 con 0x562c1d35d1d0 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18703b2740 10 client.0 _ll_register_callbacks cb 0x562c1d247030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18677fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 0x562c1d36b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18677fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 0x562c1d36b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33550/0 (socket says 172.21.15.83:33550) 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f18677fe640 1 -- 172.21.15.83:0/2614981633 learned_addr learned my addr 172.21.15.83:0/2614981633 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.682+0000 7f1867fff640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d369150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f185ffff640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d368c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18677fe640 1 -- 172.21.15.83:0/2614981633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 msgr2=0x562c1d368c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18677fe640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d368c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18677fe640 1 -- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 msgr2=0x562c1d369150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18677fe640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d369150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18677fe640 1 -- 172.21.15.83:0/2614981633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1d0342b0 con 0x562c1d35c8b0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18677fe640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 0x562c1d36b8c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f185809b8b0 tx=0x7f1858098450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ac9e2616d3d601 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f1846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f1846ffd640 1 -- 172.21.15.83:0/2614981633 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858020050 con 0x562c1d35c8b0 2024-09-19T09:02:24.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f1846ffd640 1 -- 172.21.15.83:0/2614981633 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f18580cd2f0 con 0x562c1d35c8b0 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1858009de0 con 0x562c1d35c8b0 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f1846ffd640 1 -- 172.21.15.83:0/2614981633 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f18580a4820 con 0x562c1d35c8b0 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18703b2740 10 client.15072 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c1d37a4e0 con 0x562c1d35c8b0 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f1846ffd640 1 -- 172.21.15.83:0/2614981633 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1858009de0 con 0x562c1d35c8b0 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f1846ffd640 1 -- 172.21.15.83:0/2614981633 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1858097900 con 0x562c1d35c8b0 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.683+0000 7f18703b2740 10 client.15072 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f18703b2740 10 client.15072 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f18703b2740 20 client.15072 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f18703b2740 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d37c630 0x562c1d37daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f18703b2740 4 client.15072 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 --> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c1d2d0600 con 0x562c1d37c630 2024-09-19T09:02:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f185ffff640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d37c630 0x562c1d37daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f185ffff640 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d37c630 0x562c1d37daa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b16313477983ec50 server_cookie=f1c2785ee5d33295 in_seq=0 out_seq=0 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.684+0000 7f1846ffd640 10 client.15072 ms_handle_connect on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f1846ffd640 1 -- 172.21.15.83:0/2614981633 <== mds.2 v2:172.21.15.122:6836/3109792741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c1d2d0600 con 0x562c1d37c630 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f1846ffd640 10 client.15072 handle_command_reply: tid=0 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 client.15072 shutdown 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 msgr2=0x562c1d36b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 0x562c1d36b8c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f185809b8b0 tx=0x7f1858098450 comp rx=0 tx=0).stop 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 shutdown_connections 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d37c630 0x562c1d37daa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d369150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d368c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 --2- 172.21.15.83:0/2614981633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35c8b0 0x562c1d36b8c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f1846ffd640 0 client.15072 ms_handle_reset on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 >> 172.21.15.83:0/2614981633 conn(0x562c1d358f60 msgr2=0x562c1d35ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 shutdown_connections 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 1 -- 172.21.15.83:0/2614981633 wait complete. 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.685+0000 7f18703b2740 20 client.15072 trim_cache size 0 max 16384 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 Processor -- start 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 -- start start 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d37daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d365e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 0x562c1d3663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562c1d37bde0 con 0x562c1d36bfc0 2024-09-19T09:02:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562c1d37c4b0 con 0x562c1d35c8b0 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18703b2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c1d37cb80 con 0x562c1d35d1d0 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 0x562c1d3663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 0x562c1d3663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33562/0 (socket says 172.21.15.83:33562) 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 -- 172.21.15.83:0/54547354 learned_addr learned my addr 172.21.15.83:0/54547354 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f185ffff640 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d365e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18677fe640 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d37daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 -- 172.21.15.83:0/54547354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 msgr2=0x562c1d365e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d365e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 -- 172.21.15.83:0/54547354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 msgr2=0x562c1d37daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d37daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f1867fff640 1 -- 172.21.15.83:0/54547354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c1d36eca0 con 0x562c1d36bfc0 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.703+0000 7f18677fe640 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d37daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:24.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f1867fff640 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 0x562c1d3663b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1860009bf0 tx=0x7f186001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c80700bf69463f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f185d7fa640 1 -- 172.21.15.83:0/54547354 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860013040 con 0x562c1d36bfc0 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f185d7fa640 1 -- 172.21.15.83:0/54547354 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f186000a4e0 con 0x562c1d36bfc0 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f185d7fa640 1 -- 172.21.15.83:0/54547354 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860025d10 con 0x562c1d36bfc0 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 -- 172.21.15.83:0/54547354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 msgr2=0x562c1d3663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 0x562c1d3663b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1860009bf0 tx=0x7f186001c000 comp rx=0 tx=0).stop 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 -- 172.21.15.83:0/54547354 shutdown_connections 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d36bfc0 0x562c1d3663b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35d1d0 0x562c1d365e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 --2- 172.21.15.83:0/54547354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d35c8b0 0x562c1d37daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 -- 172.21.15.83:0/54547354 >> 172.21.15.83:0/54547354 conn(0x562c1d358f60 msgr2=0x562c1d364240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 -- 172.21.15.83:0/54547354 shutdown_connections 2024-09-19T09:02:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.704+0000 7f18703b2740 1 -- 172.21.15.83:0/54547354 wait complete. 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 -- start start 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 Processor -- start 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35c8b0 0x562c1d3862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d37f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d37fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562c1d37d920 con 0x562c1d35d1d0 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562c1d37d250 con 0x562c1d36bfc0 2024-09-19T09:02:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c1d37dff0 con 0x562c1d35c8b0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f18703b2740 10 client.0 _ll_register_callbacks cb 0x7f186000a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.705+0000 7f185ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d37f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d37f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33566/0 (socket says 172.21.15.83:33566) 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 -- 172.21.15.83:0/463920730 learned_addr learned my addr 172.21.15.83:0/463920730 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f1867fff640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d37fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f18677fe640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35c8b0 0x562c1d3862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 -- 172.21.15.83:0/463920730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35c8b0 msgr2=0x562c1d3862f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35c8b0 0x562c1d3862f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 -- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 msgr2=0x562c1d37fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d37fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 -- 172.21.15.83:0/463920730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c1d3802d0 con 0x562c1d35d1d0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f185ffff640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d37f6f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f185002a940 tx=0x7f18500040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10718a0ada75dab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f1846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:24.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f1846ffd640 1 -- 172.21.15.83:0/463920730 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1850049030 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f186000a4e0 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.706+0000 7f1846ffd640 1 -- 172.21.15.83:0/463920730 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f18500314a0 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f1846ffd640 1 -- 172.21.15.83:0/463920730 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1850055050 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 10 client.15078 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c1d384bf0 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f1846ffd640 1 -- 172.21.15.83:0/463920730 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18500054d0 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f1846ffd640 1 -- 172.21.15.83:0/463920730 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1850004960 con 0x562c1d35d1d0 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 10 client.15078 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 20 client.15078 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d3eb640 0x562c1d3ea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 4 client.15078 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 --> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] -- command(tid 0: {"prefix": "status"}) -- 0x7f186000a4e0 con 0x562c1d3eb640 2024-09-19T09:02:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.707+0000 7f18677fe640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d3eb640 0x562c1d3ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f1846ffd640 10 client.15078 ms_handle_connect on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:24.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18677fe640 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d3eb640 0x562c1d3ea350 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=413117617728ae81 server_cookie=cd3fd7f5fffab222 in_seq=0 out_seq=0 2024-09-19T09:02:24.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f1846ffd640 1 -- 172.21.15.83:0/463920730 <== mds.2 v2:172.21.15.122:6836/3109792741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7f186000a4e0 con 0x562c1d3eb640 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f1846ffd640 10 client.15078 handle_command_reply: tid=0 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 client.15078 shutdown 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 msgr2=0x562c1d37f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d37f6f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f185002a940 tx=0x7f18500040b0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 shutdown_connections 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x562c1d3eb640 0x562c1d3ea350 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562c1d36bfc0 0x562c1d37fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562c1d35d1d0 0x562c1d37f6f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 --2- 172.21.15.83:0/463920730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c1d35c8b0 0x562c1d3862f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 >> 172.21.15.83:0/463920730 conn(0x562c1d358f60 msgr2=0x562c1d35e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f1846ffd640 0 client.15078 ms_handle_reset on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:24.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 shutdown_connections 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 1 -- 172.21.15.83:0/463920730 wait complete. 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.708+0000 7f18703b2740 20 client.15078 trim_cache size 0 max 16384 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 2, 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24443, 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:24.725 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 70.689128328999999, 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 128.63100035400001 2024-09-19T09:02:24.726 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f18540a32d0 msgr2=0x7f18540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f18540a32d0 0x7f18540a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1860009fd0 tx=0x7f1860009d80 comp rx=0 tx=0).stop 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 msgr2=0x7f1868199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868199290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f185800d950 tx=0x7f185800de10 comp rx=0 tx=0).stop 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 shutdown_connections 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f18540a32d0 0x7f18540a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1868106a70 0x7f18681a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868101410 0x7f18681997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 --2- 172.21.15.83:0/838364848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1868100a70 0x7f1868199290 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 >> 172.21.15.83:0/838364848 conn(0x7f18680fc790 msgr2=0x7f18680fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 shutdown_connections 2024-09-19T09:02:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:24.709+0000 7f186dfd9640 1 -- 172.21.15.83:0/838364848 wait complete. 2024-09-19T09:02:25.526 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:02:25.776 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:26.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:25 smithi083 ceph-mon[30926]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:26.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 -- 172.21.15.83:0/283484635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 msgr2=0x7f4cb01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/283484635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb01067e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009900 tx=0x7f4ca402a410 comp rx=0 tx=0).stop 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 -- 172.21.15.83:0/283484635 shutdown_connections 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/283484635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cb0106f10 0x7f4cb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/283484635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb01067e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/283484635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cb0101de0 0x7f4cb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 -- 172.21.15.83:0/283484635 >> 172.21.15.83:0/283484635 conn(0x7f4cb00fd8c0 msgr2=0x7f4cb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 -- 172.21.15.83:0/283484635 shutdown_connections 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 -- 172.21.15.83:0/283484635 wait complete. 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.295+0000 7f4cb5c34640 1 Processor -- start 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 -- start start 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cb0101de0 0x7f4cb0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cb0106f10 0x7f4cb019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0111e20 con 0x7f4cb0102790 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0111ca0 con 0x7f4cb0106f10 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4cb5c34640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0111fa0 con 0x7f4cb0101de0 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb0198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33594/0 (socket says 172.21.15.83:33594) 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 -- 172.21.15.83:0/3028946601 learned_addr learned my addr 172.21.15.83:0/3028946601 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cb0101de0 0x7f4cb0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caffff640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cb0106f10 0x7f4cb019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 -- 172.21.15.83:0/3028946601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cb0101de0 msgr2=0x7f4cb0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cb0101de0 0x7f4cb0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 -- 172.21.15.83:0/3028946601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cb0106f10 msgr2=0x7f4cb019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cb0106f10 0x7f4cb019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.296+0000 7f4caeffd640 1 -- 172.21.15.83:0/3028946601 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb019d2d0 con 0x7f4cb0102790 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.297+0000 7f4caeffd640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb0198860 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4006010 tx=0x7f4ca4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.297+0000 7f4cacff9640 1 -- 172.21.15.83:0/3028946601 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca403f030 con 0x7f4cb0102790 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.297+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb019d560 con 0x7f4cb0102790 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.297+0000 7f4cacff9640 1 -- 172.21.15.83:0/3028946601 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ca40035f0 con 0x7f4cb0102790 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.297+0000 7f4cacff9640 1 -- 172.21.15.83:0/3028946601 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4035070 con 0x7f4cb0102790 2024-09-19T09:02:26.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.297+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb01a4ea0 con 0x7f4cb0102790 2024-09-19T09:02:26.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cacff9640 1 -- 172.21.15.83:0/3028946601 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4ca4003b10 con 0x7f4cb0102790 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 Processor -- start 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 -- start start 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831607c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x560831616a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x5608316193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56083156e090 con 0x560831616fc0 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560831515a70 con 0x5608316081d0 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.300+0000 7f4cb800d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56083156a050 con 0x5608316078b0 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x5608316193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831607c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x5608316193b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33602/0 (socket says 172.21.15.83:33602) 2024-09-19T09:02:26.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 -- 172.21.15.83:0/987789993 learned_addr learned my addr 172.21.15.83:0/987789993 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4cacff9640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4c980a32d0 0x7f4c980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x560831616a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caffff640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4c980a32d0 0x7f4c980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 -- 172.21.15.83:0/987789993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 msgr2=0x560831607c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831607c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 -- 172.21.15.83:0/987789993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 msgr2=0x560831616a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x560831616a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 -- 172.21.15.83:0/987789993 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560831522130 con 0x560831616fc0 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caffff640 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831607c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4cacff9640 1 -- 172.21.15.83:0/3028946601 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4ca40f08a0 con 0x7f4cb0102790 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caeffd640 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x5608316193b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40b93d0 tx=0x7f4ca4040900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ae51753613bbf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4caffff640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4c980a32d0 0x7f4c980a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800a2c0 tx=0x7f4ca8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4c95ffb640 1 -- 172.21.15.83:0/987789993 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40bd100 con 0x560831616fc0 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.301+0000 7f4c95ffb640 1 -- 172.21.15.83:0/987789993 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ca40f7040 con 0x560831616fc0 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4c95ffb640 1 -- 172.21.15.83:0/987789993 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40c5670 con 0x560831616fc0 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 -- 172.21.15.83:0/987789993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 msgr2=0x5608316193b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x5608316193b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40b93d0 tx=0x7f4ca4040900 comp rx=0 tx=0).stop 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 -- 172.21.15.83:0/987789993 shutdown_connections 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x5608316193b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x560831616a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 --2- 172.21.15.83:0/987789993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831607c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 -- 172.21.15.83:0/987789993 >> 172.21.15.83:0/987789993 conn(0x560831603f60 msgr2=0x560831604340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 -- 172.21.15.83:0/987789993 shutdown_connections 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.302+0000 7f4cb800d740 1 -- 172.21.15.83:0/987789993 wait complete. 2024-09-19T09:02:26.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 -- start start 2024-09-19T09:02:26.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 Processor -- start 2024-09-19T09:02:26.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831616810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 0x560831613b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560831616fc0 0x5608316140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560831619950 con 0x5608316081d0 2024-09-19T09:02:26.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560831528f20 con 0x560831616fc0 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560831619ad0 con 0x5608316078b0 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4cb800d740 10 client.0 _ll_register_callbacks cb 0x5608314f2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4caeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 0x560831613b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4caeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 0x560831613b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33608/0 (socket says 172.21.15.83:33608) 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4caeffd640 1 -- 172.21.15.83:0/2359924392 learned_addr learned my addr 172.21.15.83:0/2359924392 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831616810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.303+0000 7f4caffff640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560831616fc0 0x5608316140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4caeffd640 1 -- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 msgr2=0x560831616810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4caeffd640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831616810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4caeffd640 1 -- 172.21.15.83:0/2359924392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560831616fc0 msgr2=0x5608316140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4caeffd640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560831616fc0 0x5608316140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4caeffd640 1 -- 172.21.15.83:0/2359924392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608312df2b0 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4caeffd640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 0x560831613b60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40ee470 tx=0x7f4ca4005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89c2f51e96001f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4c8effd640 1 -- 172.21.15.83:0/2359924392 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40bd100 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4c8effd640 1 -- 172.21.15.83:0/2359924392 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4ca40b9070 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca40f7040 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4c8effd640 1 -- 172.21.15.83:0/2359924392 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ca4049050 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4cb800d740 10 client.15090 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560831619950 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.304+0000 7f4c8effd640 1 -- 172.21.15.83:0/2359924392 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ca40f7040 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4c8effd640 1 -- 172.21.15.83:0/2359924392 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4ca40c51e0 con 0x5608316081d0 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4cb800d740 10 client.15090 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4cb800d740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4cb800d740 20 client.15090 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:26.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831627560 0x5608316289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4cb800d740 4 client.15090 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 --> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56083157b600 con 0x560831627560 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831627560 0x5608316289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831627560 0x5608316289d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f8ccb846ad96ce1 server_cookie=f93c6723f4410e32 in_seq=0 out_seq=0 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.305+0000 7f4c8effd640 10 client.15090 ms_handle_connect on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.306+0000 7f4c8effd640 1 -- 172.21.15.83:0/2359924392 <== mds.1 v2:172.21.15.184:6838/1323973245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56083157b600 con 0x560831627560 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.306+0000 7f4c8effd640 10 client.15090 handle_command_reply: tid=0 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.306+0000 7f4cb800d740 1 client.15090 shutdown 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.306+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 msgr2=0x560831613b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.306+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 0x560831613b60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40ee470 tx=0x7f4ca4005be0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 shutdown_connections 2024-09-19T09:02:26.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831627560 0x5608316289d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560831616fc0 0x5608316140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316081d0 0x560831613b60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2359924392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831616810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 >> 172.21.15.83:0/2359924392 conn(0x560831603f60 msgr2=0x560831609cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4c8effd640 0 client.15090 ms_handle_reset on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 shutdown_connections 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 1 -- 172.21.15.83:0/2359924392 wait complete. 2024-09-19T09:02:26.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.307+0000 7f4cb800d740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 Processor -- start 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 -- start start 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831627560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x56083160ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x56083160ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560831626d10 con 0x560831616fc0 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5608316273e0 con 0x5608316081d0 2024-09-19T09:02:26.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4cb800d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560831627ab0 con 0x5608316078b0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4caffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x56083160ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4caffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x56083160ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33622/0 (socket says 172.21.15.83:33622) 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.324+0000 7f4caffff640 1 -- 172.21.15.83:0/2757026788 learned_addr learned my addr 172.21.15.83:0/2757026788 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caeffd640 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x56083160ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caffff640 1 -- 172.21.15.83:0/2757026788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 msgr2=0x560831627560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caffff640 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831627560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caffff640 1 -- 172.21.15.83:0/2757026788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 msgr2=0x56083160ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caffff640 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x56083160ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caffff640 1 -- 172.21.15.83:0/2757026788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560831603930 con 0x560831616fc0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4caffff640 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x56083160ef60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8011d00 tx=0x7f4ca800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75f349339707d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4c957fa640 1 -- 172.21.15.83:0/2757026788 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8019070 con 0x560831616fc0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4c957fa640 1 -- 172.21.15.83:0/2757026788 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ca8003b70 con 0x560831616fc0 2024-09-19T09:02:26.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.325+0000 7f4c957fa640 1 -- 172.21.15.83:0/2757026788 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80126b0 con 0x560831616fc0 2024-09-19T09:02:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 -- 172.21.15.83:0/2757026788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 msgr2=0x56083160ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x56083160ef60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8011d00 tx=0x7f4ca800a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 -- 172.21.15.83:0/2757026788 shutdown_connections 2024-09-19T09:02:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560831616fc0 0x56083160ef60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x56083160ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 --2- 172.21.15.83:0/2757026788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608316078b0 0x560831627560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 -- 172.21.15.83:0/2757026788 >> 172.21.15.83:0/2757026788 conn(0x560831603f60 msgr2=0x560831612430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 -- 172.21.15.83:0/2757026788 shutdown_connections 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 -- 172.21.15.83:0/2757026788 wait complete. 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 -- start start 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.326+0000 7f4cb800d740 1 Processor -- start 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 0x560831630db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x5608316312f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560831616fc0 0x56083162a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560831628850 con 0x5608316078b0 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560831628180 con 0x5608316081d0 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560831628f20 con 0x560831616fc0 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 10 client.0 _ll_register_callbacks cb 0x7f4ca000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:26.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 0x560831630db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 0x560831630db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33638/0 (socket says 172.21.15.83:33638) 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 -- 172.21.15.83:0/290810153 learned_addr learned my addr 172.21.15.83:0/290810153 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caeffd640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x5608316312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 -- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560831616fc0 msgr2=0x56083162a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560831616fc0 0x56083162a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 -- 172.21.15.83:0/290810153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 msgr2=0x5608316312f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x5608316312f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 -- 172.21.15.83:0/290810153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083162a7d0 con 0x5608316078b0 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caeffd640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x5608316312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4caf7fe640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 0x560831630db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000ad50 tx=0x7f4ca00108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813383863533e6ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4c8effd640 1 -- 172.21.15.83:0/290810153 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca002b060 con 0x5608316078b0 2024-09-19T09:02:26.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4c8effd640 1 -- 172.21.15.83:0/290810153 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4ca001e8d0 con 0x5608316078b0 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.327+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca8003b70 con 0x5608316078b0 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4c8effd640 1 -- 172.21.15.83:0/290810153 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ca001ead0 con 0x5608316078b0 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 10 client.15096 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56083162f310 con 0x5608316078b0 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4c8effd640 1 -- 172.21.15.83:0/290810153 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ca8003b70 con 0x5608316078b0 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4c8effd640 1 -- 172.21.15.83:0/290810153 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4ca000f420 con 0x5608316078b0 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 10 client.15096 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 20 client.15096 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831696230 0x560831694f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 4 client.15096 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 --> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] -- command(tid 0: {"prefix": "status"}) -- 0x560831575b10 con 0x560831696230 2024-09-19T09:02:26.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.328+0000 7f4caeffd640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831696230 0x560831694f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4caeffd640 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831696230 0x560831694f40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8af8966e60d86189 server_cookie=2480c677f2c96f6e in_seq=0 out_seq=0 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4c8effd640 10 client.15096 ms_handle_connect on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4c8effd640 1 -- 172.21.15.83:0/290810153 <== mds.1 v2:172.21.15.184:6838/1323973245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560831575b10 con 0x560831696230 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4c8effd640 10 client.15096 handle_command_reply: tid=0 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 client.15096 shutdown 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 msgr2=0x560831630db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 0x560831630db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000ad50 tx=0x7f4ca00108c0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 shutdown_connections 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x560831696230 0x560831694f40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560831616fc0 0x56083162a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608316081d0 0x5608316312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4c8effd640 0 client.15096 ms_handle_reset on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 --2- 172.21.15.83:0/290810153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5608316078b0 0x560831630db0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 >> 172.21.15.83:0/290810153 conn(0x560831603f60 msgr2=0x56083160ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 shutdown_connections 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 1 -- 172.21.15.83:0/290810153 wait complete. 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.329+0000 7f4cb800d740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 1, 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24445, 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:26.335 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 73.317767848000003, 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 127.71333331 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4c980a32d0 msgr2=0x7f4c980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4c980a32d0 0x7f4c980a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800a2c0 tx=0x7f4ca8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 msgr2=0x7f4cb0198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb0198860 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4006010 tx=0x7f4ca4004270 comp rx=0 tx=0).stop 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 shutdown_connections 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f4c980a32d0 0x7f4c980a5790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cb0106f10 0x7f4cb019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb0102790 0x7f4cb0198860 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 --2- 172.21.15.83:0/3028946601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cb0101de0 0x7f4cb0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 >> 172.21.15.83:0/3028946601 conn(0x7f4cb00fd8c0 msgr2=0x7f4cb00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 shutdown_connections 2024-09-19T09:02:26.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:26.330+0000 7f4cb5c34640 1 -- 172.21.15.83:0/3028946601 wait complete. 2024-09-19T09:02:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:25 smithi184 ceph-mon[35007]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:26.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:25 smithi122 ceph-mon[34247]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:27.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:02:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:27.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 -- 172.21.15.83:0/304141041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4101df0 msgr2=0x7f7cf41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 --2- 172.21.15.83:0/304141041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4101df0 0x7f7cf41021d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009900 tx=0x7f7ce802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 -- 172.21.15.83:0/304141041 shutdown_connections 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 --2- 172.21.15.83:0/304141041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf4106f20 0x7f7cf410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 --2- 172.21.15.83:0/304141041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf41027a0 0x7f7cf41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 --2- 172.21.15.83:0/304141041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4101df0 0x7f7cf41021d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 -- 172.21.15.83:0/304141041 >> 172.21.15.83:0/304141041 conn(0x7f7cf40fd8b0 msgr2=0x7f7cf40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 -- 172.21.15.83:0/304141041 shutdown_connections 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.770+0000 7f7cfad93640 1 -- 172.21.15.83:0/304141041 wait complete. 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 Processor -- start 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 -- start start 2024-09-19T09:02:27.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf4101df0 0x7f7cf4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf41027a0 0x7f7cf4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 0x7f7cf419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4111df0 con 0x7f7cf4106f20 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4111c70 con 0x7f7cf41027a0 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cfad93640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4111f70 con 0x7f7cf4101df0 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 0x7f7cf419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 0x7f7cf419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33660/0 (socket says 172.21.15.83:33660) 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 -- 172.21.15.83:0/1501227016 learned_addr learned my addr 172.21.15.83:0/1501227016 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf4101df0 0x7f7cf4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf41027a0 0x7f7cf4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 -- 172.21.15.83:0/1501227016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf4101df0 msgr2=0x7f7cf4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf4101df0 0x7f7cf4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 -- 172.21.15.83:0/1501227016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf41027a0 msgr2=0x7f7cf4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf41027a0 0x7f7cf4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf9330640 1 -- 172.21.15.83:0/1501227016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf419d3e0 con 0x7f7cf4106f20 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.771+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf41027a0 0x7f7cf4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.772+0000 7f7cf9330640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 0x7f7cf419cd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00eaa0 tx=0x7f7cec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.772+0000 7f7cf1ffb640 1 -- 172.21.15.83:0/1501227016 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00cdb0 con 0x7f7cf4106f20 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.772+0000 7f7cf1ffb640 1 -- 172.21.15.83:0/1501227016 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec005020 con 0x7f7cf4106f20 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.772+0000 7f7cf1ffb640 1 -- 172.21.15.83:0/1501227016 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0116d0 con 0x7f7cf4106f20 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.772+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf419d6d0 con 0x7f7cf4106f20 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.772+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf41a4fb0 con 0x7f7cf4106f20 2024-09-19T09:02:27.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.774+0000 7f7cf1ffb640 1 -- 172.21.15.83:0/1501227016 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7cec0051d0 con 0x7f7cf4106f20 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.774+0000 7f7cfd16c740 1 Processor -- start 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 -- start start 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf1ffb640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7ce40a3350 0x7f7ce40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb615db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb620670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb622fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb57c090 con 0x55a6cb6162f0 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb523a70 con 0x55a6cb6159d0 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb578050 con 0x55a6cb620bb0 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf1ffb640 1 -- 172.21.15.83:0/1501227016 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7cec0cffa0 con 0x7f7cf4106f20 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7ce40a3350 0x7f7ce40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb620670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb620670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33672/0 (socket says 172.21.15.83:33672) 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 -- 172.21.15.83:0/3391536087 learned_addr learned my addr 172.21.15.83:0/3391536087 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf9330640 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb622fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb615db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 -- 172.21.15.83:0/3391536087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 msgr2=0x55a6cb622fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb622fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 -- 172.21.15.83:0/3391536087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 msgr2=0x55a6cb615db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb615db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 -- 172.21.15.83:0/3391536087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cb530130 con 0x55a6cb6162f0 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf9330640 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb622fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7ce40a3350 0x7f7ce40a5810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000cfd0 tx=0x7f7ce000cc60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.775+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb620670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0011ce0 tx=0x7f7ce001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef164da7863580d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cdeffd640 1 -- 172.21.15.83:0/3391536087 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0022070 con 0x55a6cb6162f0 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cdeffd640 1 -- 172.21.15.83:0/3391536087 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ce000fc60 con 0x55a6cb6162f0 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cdeffd640 1 -- 172.21.15.83:0/3391536087 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0012940 con 0x55a6cb6162f0 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 -- 172.21.15.83:0/3391536087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 msgr2=0x55a6cb620670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb620670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0011ce0 tx=0x7f7ce001b000 comp rx=0 tx=0).stop 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 -- 172.21.15.83:0/3391536087 shutdown_connections 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb622fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb620670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/3391536087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb615db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.776+0000 7f7cfd16c740 1 -- 172.21.15.83:0/3391536087 >> 172.21.15.83:0/3391536087 conn(0x55a6cb611f60 msgr2=0x55a6cb612340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 -- 172.21.15.83:0/3391536087 shutdown_connections 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 -- 172.21.15.83:0/3391536087 wait complete. 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 -- start start 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 Processor -- start 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb620430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb61d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb61dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb623780 con 0x55a6cb6162f0 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb536f20 con 0x55a6cb6159d0 2024-09-19T09:02:27.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb623900 con 0x55a6cb620bb0 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cfd16c740 10 client.0 _ll_register_callbacks cb 0x55a6cb500030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.777+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb61d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb61d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33682/0 (socket says 172.21.15.83:33682) 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1522296760 learned_addr learned my addr 172.21.15.83:0/1522296760 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf9330640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb61dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb620430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1522296760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 msgr2=0x55a6cb61dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb61dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 msgr2=0x55a6cb620430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb620430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1522296760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cb2ed2b0 con 0x55a6cb6162f0 2024-09-19T09:02:27.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb61d780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000fc30 tx=0x7f7ce0014760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5461bf59692d7986 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:27.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1522296760 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0022070 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1522296760 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7ce00126e0 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ce000fc60 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1522296760 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ce0038050 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cfd16c740 10 client.15108 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.778+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a6cb62f050 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1522296760 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ce000fc60 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1522296760 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7ce0004710 con 0x55a6cb6162f0 2024-09-19T09:02:27.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cfd16c740 10 client.15108 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cfd16c740 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cfd16c740 20 client.15108 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6314c0 0x55a6cb632930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cfd16c740 4 client.15108 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 --> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6cb589600 con 0x55a6cb6314c0 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.779+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6314c0 0x55a6cb632930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cd3fff640 10 client.15108 ms_handle_connect on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:27.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6314c0 0x55a6cb632930 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330c70199ef62b88 server_cookie=2b55de2c7783ae1d in_seq=0 out_seq=0 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1522296760 <== mds.0 v2:172.21.15.122:6838/1686011933 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6cb589600 con 0x55a6cb6314c0 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cd3fff640 10 client.15108 handle_command_reply: tid=0 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cfd16c740 1 client.15108 shutdown 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 msgr2=0x55a6cb61d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb61d780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000fc30 tx=0x7f7ce0014760 comp rx=0 tx=0).stop 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 shutdown_connections 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.780+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6314c0 0x55a6cb632930 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb61dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb61d780 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cd3fff640 0 client.15108 ms_handle_reset on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:27.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1522296760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb620430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 >> 172.21.15.83:0/1522296760 conn(0x55a6cb611f60 msgr2=0x55a6cb617c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 shutdown_connections 2024-09-19T09:02:27.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1522296760 wait complete. 2024-09-19T09:02:27.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.781+0000 7f7cfd16c740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T09:02:27.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 Processor -- start 2024-09-19T09:02:27.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 -- start start 2024-09-19T09:02:27.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb632930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb6162f0 0x55a6cb63ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 0x55a6cb63b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb630c70 con 0x55a6cb620bb0 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb631340 con 0x55a6cb6159d0 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb631a10 con 0x55a6cb6162f0 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cf9330640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 0x55a6cb63b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cf9330640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 0x55a6cb63b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33686/0 (socket says 172.21.15.83:33686) 2024-09-19T09:02:27.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cf9330640 1 -- 172.21.15.83:0/558779438 learned_addr learned my addr 172.21.15.83:0/558779438 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.798+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb632930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb6162f0 0x55a6cb63ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf9330640 1 -- 172.21.15.83:0/558779438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb6162f0 msgr2=0x55a6cb63ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf9330640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb6162f0 0x55a6cb63ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf9330640 1 -- 172.21.15.83:0/558779438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 msgr2=0x55a6cb632930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf9330640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb632930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf9330640 1 -- 172.21.15.83:0/558779438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cb615800 con 0x55a6cb620bb0 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf9330640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 0x55a6cb63b150 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7cec098500 tx=0x7f7cec09c0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e58a3a3215d5f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb632930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cde7fc640 1 -- 172.21.15.83:0/558779438 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0b5070 con 0x55a6cb620bb0 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb6162f0 0x55a6cb63ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cde7fc640 1 -- 172.21.15.83:0/558779438 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec0a4d10 con 0x55a6cb620bb0 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.799+0000 7f7cde7fc640 1 -- 172.21.15.83:0/558779438 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec01f040 con 0x55a6cb620bb0 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 -- 172.21.15.83:0/558779438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 msgr2=0x55a6cb63b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 0x55a6cb63b150 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7cec098500 tx=0x7f7cec09c0a0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 -- 172.21.15.83:0/558779438 shutdown_connections 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb620bb0 0x55a6cb63b150 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb6162f0 0x55a6cb63ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/558779438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb632930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 -- 172.21.15.83:0/558779438 >> 172.21.15.83:0/558779438 conn(0x55a6cb611f60 msgr2=0x55a6cb6304c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 -- 172.21.15.83:0/558779438 shutdown_connections 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 -- 172.21.15.83:0/558779438 wait complete. 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 -- start start 2024-09-19T09:02:27.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.800+0000 7f7cfd16c740 1 Processor -- start 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb63acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb63b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb636100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb6327b0 con 0x55a6cb6162f0 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb6320e0 con 0x55a6cb6159d0 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a6cb632e80 con 0x55a6cb620bb0 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 10 client.0 _ll_register_callbacks cb 0x7f7ce0011c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb63b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb63b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33688/0 (socket says 172.21.15.83:33688) 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1567440527 learned_addr learned my addr 172.21.15.83:0/1567440527 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb63acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1567440527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 msgr2=0x55a6cb636100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb636100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 msgr2=0x55a6cb63acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb63acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 -- 172.21.15.83:0/1567440527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cb636900 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cf3fff640 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb63b1f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c390 tx=0x7f7ce0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f05123b8fea5bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1567440527 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0022050 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1567440527 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7ce0004680 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.801+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cec0a4d10 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1567440527 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ce000fe60 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 10 client.15114 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a6cb69b5c0 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1567440527 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cec0a4d10 con 0x55a6cb6162f0 2024-09-19T09:02:27.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1567440527 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7ce0027900 con 0x55a6cb6162f0 2024-09-19T09:02:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 10 client.15114 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:02:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 20 client.15114 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6a0160 0x55a6cb69ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 4 client.15114 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:27.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 --> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] -- command(tid 0: {"prefix": "status"}) -- 0x55a6cb583b10 con 0x55a6cb6a0160 2024-09-19T09:02:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.802+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6a0160 0x55a6cb69ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cd3fff640 10 client.15114 ms_handle_connect on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cf8b2f640 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6a0160 0x55a6cb69ee70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a60e94137604e25 server_cookie=7054fc78f5c4a172 in_seq=0 out_seq=0 2024-09-19T09:02:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cd3fff640 1 -- 172.21.15.83:0/1567440527 <== mds.0 v2:172.21.15.122:6838/1686011933 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55a6cb583b10 con 0x55a6cb6a0160 2024-09-19T09:02:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cd3fff640 10 client.15114 handle_command_reply: tid=0 2024-09-19T09:02:27.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 client.15114 shutdown 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 msgr2=0x55a6cb63b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb63b1f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c390 tx=0x7f7ce0011ba0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 shutdown_connections 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x55a6cb6a0160 0x55a6cb69ee70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a6cb620bb0 0x55a6cb636100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a6cb6162f0 0x55a6cb63b1f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cd3fff640 0 client.15114 ms_handle_reset on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 --2- 172.21.15.83:0/1567440527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6cb6159d0 0x55a6cb63acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 >> 172.21.15.83:0/1567440527 conn(0x55a6cb611f60 msgr2=0x55a6cb61edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 shutdown_connections 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 1 -- 172.21.15.83:0/1567440527 wait complete. 2024-09-19T09:02:27.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.803+0000 7f7cfd16c740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24476, 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 109.745104836, 2024-09-19T09:02:27.827 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:27.828 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:27.828 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:27.828 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 120.310256232 2024-09-19T09:02:27.828 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7ce40a3350 msgr2=0x7f7ce40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7ce40a3350 0x7f7ce40a5810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000cfd0 tx=0x7f7ce000cc60 comp rx=0 tx=0).stop 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 msgr2=0x7f7cf419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 0x7f7cf419cd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00eaa0 tx=0x7f7cec00ef60 comp rx=0 tx=0).stop 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 shutdown_connections 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f7ce40a3350 0x7f7ce40a5810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf4106f20 0x7f7cf419cd00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf41027a0 0x7f7cf4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 --2- 172.21.15.83:0/1501227016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf4101df0 0x7f7cf4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 >> 172.21.15.83:0/1501227016 conn(0x7f7cf40fd8b0 msgr2=0x7f7cf40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 shutdown_connections 2024-09-19T09:02:27.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:27.804+0000 7f7cfad93640 1 -- 172.21.15.83:0/1501227016 wait complete. 2024-09-19T09:02:28.270 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:27 smithi083 ceph-mon[30926]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:27 smithi184 ceph-mon[35007]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:28.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:27 smithi122 ceph-mon[34247]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:28.702 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:02:28.702 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:02:28.716 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:02:28.717 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:02:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:29.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 -- 172.21.15.83:0/2301633392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 msgr2=0x7f27c4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 --2- 172.21.15.83:0/2301633392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c4108f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009ca0 tx=0x7f27bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 -- 172.21.15.83:0/2301633392 shutdown_connections 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 --2- 172.21.15.83:0/2301633392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c4108f20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 --2- 172.21.15.83:0/2301633392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c4101cd0 0x7f27c4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 --2- 172.21.15.83:0/2301633392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4100ad0 0x7f27c4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 -- 172.21.15.83:0/2301633392 >> 172.21.15.83:0/2301633392 conn(0x7f27c40fc280 msgr2=0x7f27c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 -- 172.21.15.83:0/2301633392 shutdown_connections 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 -- 172.21.15.83:0/2301633392 wait complete. 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 Processor -- start 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.390+0000 7f27cbe27640 1 -- start start 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27cbe27640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4100ad0 0x7f27c4197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27cbe27640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c4101cd0 0x7f27c41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27cbe27640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c419f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27cbe27640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f27c410c5e0 con 0x7f27c4102690 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27cbe27640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27c410c460 con 0x7f27c4100ad0 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27cbe27640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27c410c760 con 0x7f27c4101cd0 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c419f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c419f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33698/0 (socket says 172.21.15.83:33698) 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 -- 172.21.15.83:0/1009728017 learned_addr learned my addr 172.21.15.83:0/1009728017 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27c9bc3640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4100ad0 0x7f27c4197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27c93c2640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c4101cd0 0x7f27c41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 -- 172.21.15.83:0/1009728017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c4101cd0 msgr2=0x7f27c41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c4101cd0 0x7f27c41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 -- 172.21.15.83:0/1009728017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4100ad0 msgr2=0x7f27c4197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4100ad0 0x7f27c4197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 -- 172.21.15.83:0/1009728017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c419f9e0 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27ca3c4640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c419f370 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009dc0 tx=0x7f27bc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.391+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc032ec0 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.392+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27bc0044f0 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.392+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c419fc70 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.392+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc030d40 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.392+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c41a01b0 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.392+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c41a0380 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.394+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f27bc004040 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.395+0000 7f27baffd640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27b00a34a0 0x7f27b00a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.395+0000 7f27c9bc3640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27b00a34a0 0x7f27b00a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.395+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f27bc0f1360 con 0x7f27c4102690 2024-09-19T09:02:29.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.395+0000 7f27c9bc3640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27b00a34a0 0x7f27b00a5960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f27c4101b30 tx=0x7f27b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:29.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.398+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27bc0bdcd0 con 0x7f27c4102690 2024-09-19T09:02:29.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.581+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f27c41a0550 con 0x7f27b00a34a0 2024-09-19T09:02:29.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.582+0000 7f27baffd640 1 -- 172.21.15.83:0/1009728017 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f27c41a0550 con 0x7f27b00a34a0 2024-09-19T09:02:29.583 INFO:teuthology.orchestra.run.smithi083.stdout:Backend: cephadm 2024-09-19T09:02:29.583 INFO:teuthology.orchestra.run.smithi083.stdout:Available: Yes 2024-09-19T09:02:29.583 INFO:teuthology.orchestra.run.smithi083.stdout:Paused: No 2024-09-19T09:02:29.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27b00a34a0 msgr2=0x7f27b00a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27b00a34a0 0x7f27b00a5960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f27c4101b30 tx=0x7f27b400b390 comp rx=0 tx=0).stop 2024-09-19T09:02:29.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 msgr2=0x7f27c419f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c419f370 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009dc0 tx=0x7f27bc003ba0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 shutdown_connections 2024-09-19T09:02:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f27b00a34a0 0x7f27b00a5960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27c4102690 0x7f27c419f370 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27c4101cd0 0x7f27c41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 --2- 172.21.15.83:0/1009728017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27c4100ad0 0x7f27c4197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.584+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 >> 172.21.15.83:0/1009728017 conn(0x7f27c40fc280 msgr2=0x7f27c406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:29.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.585+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 shutdown_connections 2024-09-19T09:02:29.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:29.585+0000 7f27cbe27640 1 -- 172.21.15.83:0/1009728017 wait complete. 2024-09-19T09:02:30.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:30 smithi083 ceph-mon[30926]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:30.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:02:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:30 smithi184 ceph-mon[35007]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:30.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:30 smithi122 ceph-mon[34247]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:30.623 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 -- 172.21.15.83:0/1704876273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0fff10 msgr2=0x7fa89c100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/1704876273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0fff10 0x7fa89c100310 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009cd0 tx=0x7fa88c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 -- 172.21.15.83:0/1704876273 shutdown_connections 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/1704876273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa89c1038b0 0x7fa89c10a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/1704876273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa89c102ef0 0x7fa89c103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/1704876273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0fff10 0x7fa89c100310 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 -- 172.21.15.83:0/1704876273 >> 172.21.15.83:0/1704876273 conn(0x7fa89c0fba80 msgr2=0x7fa89c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 -- 172.21.15.83:0/1704876273 shutdown_connections 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 -- 172.21.15.83:0/1704876273 wait complete. 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 Processor -- start 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.120+0000 7fa8a0f28640 1 -- start start 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa8a0f28640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa89c0fff10 0x7fa89c102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa8a0f28640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 0x7fa89c100ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa8a0f28640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa89c1038b0 0x7fa89c1013e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa8a0f28640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c10d7b0 con 0x7fa89c102ef0 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa8a0f28640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c10d630 con 0x7fa89c1038b0 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa8a0f28640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c10d930 con 0x7fa89c0fff10 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 0x7fa89c100ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 0x7fa89c100ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39900/0 (socket says 172.21.15.83:39900) 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 -- 172.21.15.83:0/2258340593 learned_addr learned my addr 172.21.15.83:0/2258340593 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa89ad9d640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa89c1038b0 0x7fa89c1013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa89a59c640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa89c0fff10 0x7fa89c102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 -- 172.21.15.83:0/2258340593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa89c0fff10 msgr2=0x7fa89c102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa89c0fff10 0x7fa89c102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 -- 172.21.15.83:0/2258340593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa89c1038b0 msgr2=0x7fa89c1013e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa89c1038b0 0x7fa89c1013e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 -- 172.21.15.83:0/2258340593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c101ca0 con 0x7fa89c102ef0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.121+0000 7fa899d9b640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 0x7fa89c100ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa88400b4a0 tx=0x7fa88400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.122+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884014070 con 0x7fa89c102ef0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.122+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa884010ac0 con 0x7fa89c102ef0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.122+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884017c30 con 0x7fa89c102ef0 2024-09-19T09:02:31.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.122+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89c1a1ff0 con 0x7fa89c102ef0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.122+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89c1a2570 con 0x7fa89c102ef0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.123+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89c1091e0 con 0x7fa89c102ef0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.124+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa884017070 con 0x7fa89c102ef0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.125+0000 7fa8937fe640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8880a3350 0x7fa8880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.125+0000 7fa89a59c640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8880a3350 0x7fa8880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.125+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa8840cf260 con 0x7fa89c102ef0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.125+0000 7fa89a59c640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8880a3350 0x7fa8880a5810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009ca0 tx=0x7fa88c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:31.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.129+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa88409b580 con 0x7fa89c102ef0 2024-09-19T09:02:31.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.305+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa89c062630 con 0x7fa8880a3350 2024-09-19T09:02:31.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:31 smithi083 ceph-mon[30926]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.318+0000 7fa8937fe640 1 -- 172.21.15.83:0/2258340593 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7fa89c062630 con 0x7fa8880a3350 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.a smithi083 running (2m) 54s ago 2m 17.4M - 19.1.1-361-g2f599a46 d2baa855c067 0f6e657e40e6 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.b smithi122 running (2m) 56s ago 2m 26.6M - 19.1.1-361-g2f599a46 d2baa855c067 5d57d7561423 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.c smithi184 running (2m) 56s ago 2m 19.8M - 19.1.1-361-g2f599a46 d2baa855c067 92a1dc137dce 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.d smithi083 running (2m) 54s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 590bfce4f875 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.e smithi122 running (2m) 56s ago 2m 15.7M - 19.1.1-361-g2f599a46 d2baa855c067 4fecdcf786e3 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.f smithi184 running (2m) 56s ago 2m 18.2M - 19.1.1-361-g2f599a46 d2baa855c067 983f3870c3b8 2024-09-19T09:02:31.318 INFO:teuthology.orchestra.run.smithi083.stdout:mds.g smithi083 running (2m) 54s ago 2m 15.4M - 19.1.1-361-g2f599a46 d2baa855c067 6887e1914748 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mds.h smithi122 running (2m) 56s ago 2m 17.6M - 19.1.1-361-g2f599a46 d2baa855c067 55448c28fc26 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mds.i smithi184 running (2m) 56s ago 2m 17.7M - 19.1.1-361-g2f599a46 d2baa855c067 56af261455cf 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mds.j smithi083 running (2m) 54s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 972c34db5ab5 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mds.k smithi122 running (2m) 56s ago 2m 14.9M - 19.1.1-361-g2f599a46 d2baa855c067 de3d22b1ac16 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mds.l smithi184 running (2m) 56s ago 2m 17.4M - 19.1.1-361-g2f599a46 d2baa855c067 5a3aec50ab11 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.x smithi083 *:9283,8765 running (9m) 54s ago 9m 510M - 19.1.1-361-g2f599a46 d2baa855c067 f631a58ea865 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.y smithi122 *:8443,8765 running (7m) 56s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 4db07b8dda5f 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.z smithi184 *:8443,8765 running (7m) 56s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 51bd24853024 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mon.a smithi083 running (9m) 54s ago 9m 49.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4f1d81f95fcb 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mon.b smithi122 running (8m) 56s ago 8m 39.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 91311b3e861f 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:mon.c smithi184 running (8m) 56s ago 8m 40.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 fd8b0b47c331 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 smithi083 running (7m) 54s ago 7m 53.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 10ec24c586a0 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 smithi122 running (7m) 56s ago 7m 55.5M 4271M 19.1.1-361-g2f599a46 d2baa855c067 85cf9f392289 2024-09-19T09:02:31.319 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 smithi184 running (6m) 56s ago 6m 47.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 555a35c33ae8 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 smithi083 running (6m) 54s ago 6m 44.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4974cfbda4ee 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 smithi122 running (5m) 56s ago 5m 42.5M 4271M 19.1.1-361-g2f599a46 d2baa855c067 cf4aa10f693a 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 smithi184 running (5m) 56s ago 5m 52.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 53c60fe9fa04 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 smithi083 running (5m) 54s ago 5m 44.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 41bb141ed17d 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 smithi122 running (4m) 56s ago 4m 52.5M 4271M 19.1.1-361-g2f599a46 d2baa855c067 fa7550496523 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.8 smithi184 running (4m) 56s ago 4m 51.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 feaa12b4dc34 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.9 smithi083 running (3m) 54s ago 3m 41.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f9a1b1308a71 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.10 smithi122 running (3m) 56s ago 3m 42.8M 4271M 19.1.1-361-g2f599a46 d2baa855c067 1583a8c6283c 2024-09-19T09:02:31.320 INFO:teuthology.orchestra.run.smithi083.stdout:osd.11 smithi184 running (2m) 56s ago 2m 44.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 924f039022c0 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8880a3350 msgr2=0x7fa8880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8880a3350 0x7fa8880a5810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009ca0 tx=0x7fa88c009360 comp rx=0 tx=0).stop 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 msgr2=0x7fa89c100ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 0x7fa89c100ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa88400b4a0 tx=0x7fa88400b960 comp rx=0 tx=0).stop 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 shutdown_connections 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa8880a3350 0x7fa8880a5810 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa89c1038b0 0x7fa89c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c102ef0 0x7fa89c100ea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 --2- 172.21.15.83:0/2258340593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa89c0fff10 0x7fa89c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 >> 172.21.15.83:0/2258340593 conn(0x7fa89c0fba80 msgr2=0x7fa89c1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 shutdown_connections 2024-09-19T09:02:31.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:31.320+0000 7fa8a0f28640 1 -- 172.21.15.83:0/2258340593 wait complete. 2024-09-19T09:02:31.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:31 smithi184 ceph-mon[35007]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:31.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:31 smithi122 ceph-mon[34247]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:32.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:02:32.044 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:32 smithi083 ceph-mon[30926]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:32.267 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:32.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:32 smithi184 ceph-mon[35007]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:32 smithi122 ceph-mon[34247]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3830512761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44101cd0 msgr2=0x7f6c44102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3830512761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44101cd0 0x7f6c44102150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009900 tx=0x7f6c3002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3830512761 shutdown_connections 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3830512761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44102690 0x7f6c44108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3830512761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44101cd0 0x7f6c44102150 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3830512761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c44100ad0 0x7f6c44100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3830512761 >> 172.21.15.83:0/3830512761 conn(0x7f6c440fc280 msgr2=0x7f6c440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3830512761 shutdown_connections 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.734+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3830512761 wait complete. 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 Processor -- start 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 -- start start 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c44100ad0 0x7f6c44196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44101cd0 0x7f6c44197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 0x7f6c4419e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4410c600 con 0x7f6c44102690 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4410c480 con 0x7f6c44101cd0 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c4abf5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4410c780 con 0x7f6c44100ad0 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 0x7f6c4419e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 0x7f6c4419e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39918/0 (socket says 172.21.15.83:39918) 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 -- 172.21.15.83:0/3989823087 learned_addr learned my addr 172.21.15.83:0/3989823087 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c43fff640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44101cd0 0x7f6c44197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c48991640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c44100ad0 0x7f6c44196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 -- 172.21.15.83:0/3989823087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c44100ad0 msgr2=0x7f6c44196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c44100ad0 0x7f6c44196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 -- 172.21.15.83:0/3989823087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44101cd0 msgr2=0x7f6c44197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44101cd0 0x7f6c44197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 -- 172.21.15.83:0/3989823087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4419e910 con 0x7f6c44102690 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c43fff640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44101cd0 0x7f6c44197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c49192640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 0x7f6c4419e270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007cb0 tx=0x7f6c3c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.735+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00eb30 con 0x7f6c44102690 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.736+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c3c00ecd0 con 0x7f6c44102690 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.736+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0153f0 con 0x7f6c44102690 2024-09-19T09:02:32.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.736+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c44069fd0 con 0x7f6c44102690 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.736+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4406a4c0 con 0x7f6c44102690 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.737+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c44100ed0 con 0x7f6c44102690 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.738+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6c3c00a440 con 0x7f6c44102690 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.738+0000 7f6c41ffb640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6c340a3350 0x7f6c340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.738+0000 7f6c48991640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6c340a3350 0x7f6c340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.738+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6c3c0d1a30 con 0x7f6c44102690 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.739+0000 7f6c48991640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6c340a3350 0x7f6c340a5810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c38005fd0 tx=0x7f6c38005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.742+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c3c09e290 con 0x7f6c44102690 2024-09-19T09:02:32.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.916+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f6c4406a720 con 0x7f6c340a3350 2024-09-19T09:02:32.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.921+0000 7f6c41ffb640 1 -- 172.21.15.83:0/3989823087 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f6c4406a720 con 0x7f6c340a3350 2024-09-19T09:02:32.922 INFO:teuthology.orchestra.run.smithi083.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:02:32.922 INFO:teuthology.orchestra.run.smithi083.stdout:mds.all 12/12 58s ago 2m smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-19T09:02:32.922 INFO:teuthology.orchestra.run.smithi083.stdout:mgr 3/3 58s ago 7m smithi083=x;smithi122=y;smithi184=z;count:3 2024-09-19T09:02:32.922 INFO:teuthology.orchestra.run.smithi083.stdout:mon 3/3 58s ago 8m smithi083:172.21.15.83=a;smithi122:172.21.15.122=b;smithi184:172.21.15.184=c;count:3 2024-09-19T09:02:32.922 INFO:teuthology.orchestra.run.smithi083.stdout:osd 12 58s ago - 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6c340a3350 msgr2=0x7f6c340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6c340a3350 0x7f6c340a5810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c38005fd0 tx=0x7f6c38005850 comp rx=0 tx=0).stop 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 msgr2=0x7f6c4419e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 0x7f6c4419e270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007cb0 tx=0x7f6c3c00e420 comp rx=0 tx=0).stop 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 shutdown_connections 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6c340a3350 0x7f6c340a5810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102690 0x7f6c4419e270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c44101cd0 0x7f6c44197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 --2- 172.21.15.83:0/3989823087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c44100ad0 0x7f6c44196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 >> 172.21.15.83:0/3989823087 conn(0x7f6c440fc280 msgr2=0x7f6c44105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 shutdown_connections 2024-09-19T09:02:32.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:32.924+0000 7f6c4abf5640 1 -- 172.21.15.83:0/3989823087 wait complete. 2024-09-19T09:02:33.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:33 smithi083 ceph-mon[30926]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:33.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:33 smithi184 ceph-mon[35007]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:33 smithi122 ceph-mon[34247]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:33.731 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:02:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:34.271 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:34 smithi083 ceph-mon[30926]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:34.271 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:34 smithi083 ceph-mon[30926]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:34.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:34 smithi184 ceph-mon[35007]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:34.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:34 smithi184 ceph-mon[35007]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:34.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:34 smithi122 ceph-mon[34247]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:34 smithi122 ceph-mon[34247]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/2789828507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 msgr2=0x7fb3f4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/2789828507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4102000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009900 tx=0x7fb3f002a410 comp rx=0 tx=0).stop 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/2789828507 shutdown_connections 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/2789828507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f41037c0 0x7fb3f410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/2789828507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3f4102e00 0x7fb3f4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/2789828507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4102000 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/2789828507 >> 172.21.15.83:0/2789828507 conn(0x7fb3f40fd390 msgr2=0x7fb3f40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:34.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/2789828507 shutdown_connections 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/2789828507 wait complete. 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 Processor -- start 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.529+0000 7fb3fc4b7640 1 -- start start 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f4102e00 0x7fb3f40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3f41037c0 0x7fb3f4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f410d790 con 0x7fb3f4101c00 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f410d610 con 0x7fb3f41037c0 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f410d910 con 0x7fb3f4102e00 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39926/0 (socket says 172.21.15.83:39926) 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 -- 172.21.15.83:0/836257773 learned_addr learned my addr 172.21.15.83:0/836257773 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3faa54640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3f41037c0 0x7fb3f4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3f9a52640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f4102e00 0x7fb3f40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 -- 172.21.15.83:0/836257773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f4102e00 msgr2=0x7fb3f40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f4102e00 0x7fb3f40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 -- 172.21.15.83:0/836257773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3f41037c0 msgr2=0x7fb3f4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3f41037c0 0x7fb3f4074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 -- 172.21.15.83:0/836257773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f40753e0 con 0x7fb3f4101c00 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fa253640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4075f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00314e0 tx=0x7fb3f00042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f003f030 con 0x7fb3f4101c00 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3f0003cb0 con 0x7fb3f4101c00 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f41a1fe0 con 0x7fb3f4101c00 2024-09-19T09:02:34.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.530+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0035070 con 0x7fb3f4101c00 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.531+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f41a2400 con 0x7fb3f4101c00 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.531+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f4109050 con 0x7fb3f4101c00 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.533+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb3f0042030 con 0x7fb3f4101c00 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.533+0000 7fb3eb7fe640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb3e00a32d0 0x7fb3e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.533+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb3f00f0830 con 0x7fb3f4101c00 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.533+0000 7fb3f9a52640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb3e00a32d0 0x7fb3e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.534+0000 7fb3f9a52640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb3e00a32d0 0x7fb3e00a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4005fd0 tx=0x7fb3e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:34.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.536+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3f00bd090 con 0x7fb3f4101c00 2024-09-19T09:02:34.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.709+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb3f4062630 con 0x7fb3e00a32d0 2024-09-19T09:02:34.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.710+0000 7fb3eb7fe640 1 -- 172.21.15.83:0/836257773 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fb3f4062630 con 0x7fb3e00a32d0 2024-09-19T09:02:34.710 INFO:teuthology.orchestra.run.smithi083.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:02:34.710 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 172.21.15.83 2024-09-19T09:02:34.710 INFO:teuthology.orchestra.run.smithi083.stdout:smithi122 172.21.15.122 2024-09-19T09:02:34.710 INFO:teuthology.orchestra.run.smithi083.stdout:smithi184 172.21.15.184 2024-09-19T09:02:34.710 INFO:teuthology.orchestra.run.smithi083.stdout:3 hosts in cluster 2024-09-19T09:02:34.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb3e00a32d0 msgr2=0x7fb3e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb3e00a32d0 0x7fb3e00a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4005fd0 tx=0x7fb3e4005850 comp rx=0 tx=0).stop 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 msgr2=0x7fb3f4075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4075f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00314e0 tx=0x7fb3f00042e0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 shutdown_connections 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fb3e00a32d0 0x7fb3e00a5790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3f41037c0 0x7fb3f4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f4102e00 0x7fb3f40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 --2- 172.21.15.83:0/836257773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb3f4101c00 0x7fb3f4075f90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 >> 172.21.15.83:0/836257773 conn(0x7fb3f40fd390 msgr2=0x7fb3f4106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 shutdown_connections 2024-09-19T09:02:34.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:34.712+0000 7fb3fc4b7640 1 -- 172.21.15.83:0/836257773 wait complete. 2024-09-19T09:02:35.463 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:02:35.709 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.141 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:36 smithi083 ceph-mon[30926]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:36.141 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:36 smithi083 ceph-mon[30926]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:36.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 -- 172.21.15.83:0/3625739074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c4101d10 msgr2=0x7f33c4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:36.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 --2- 172.21.15.83:0/3625739074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c4101d10 0x7f33c4102190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009900 tx=0x7f33ac02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 -- 172.21.15.83:0/3625739074 shutdown_connections 2024-09-19T09:02:36.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 --2- 172.21.15.83:0/3625739074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33c41026d0 0x7f33c4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 --2- 172.21.15.83:0/3625739074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c4101d10 0x7f33c4102190 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 --2- 172.21.15.83:0/3625739074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 0x7f33c4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 -- 172.21.15.83:0/3625739074 >> 172.21.15.83:0/3625739074 conn(0x7f33c40fc2a0 msgr2=0x7f33c40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 -- 172.21.15.83:0/3625739074 shutdown_connections 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.221+0000 7f33c9a29640 1 -- 172.21.15.83:0/3625739074 wait complete. 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 Processor -- start 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 -- start start 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 0x7f33c4197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33c4101d10 0x7f33c4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 0x7f33c419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33c410d7b0 con 0x7f33c41026d0 2024-09-19T09:02:36.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f33c410d630 con 0x7f33c4100b10 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c9a29640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f33c410d930 con 0x7f33c4101d10 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 0x7f33c419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 0x7f33c419f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39930/0 (socket says 172.21.15.83:39930) 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.222+0000 7f33c37fe640 1 -- 172.21.15.83:0/2443036573 learned_addr learned my addr 172.21.15.83:0/2443036573 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 0x7f33c4197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33ba7fc640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33c4101d10 0x7f33c4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c37fe640 1 -- 172.21.15.83:0/2443036573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33c4101d10 msgr2=0x7f33c4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c37fe640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33c4101d10 0x7f33c4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c37fe640 1 -- 172.21.15.83:0/2443036573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 msgr2=0x7f33c4197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c37fe640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 0x7f33c4197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c37fe640 1 -- 172.21.15.83:0/2443036573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c419fa60 con 0x7f33c41026d0 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 0x7f33c4197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c37fe640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 0x7f33c419f3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00b970 tx=0x7f33bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:36.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc019070 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c419fd50 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33bc014440 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0075d0 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.223+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c41a02d0 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.224+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c4107ee0 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.225+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f33bc01c070 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.226+0000 7f33c8a27640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f33b00a3300 0x7f33b00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.226+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f33b00a3300 0x7f33b00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.226+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f33bc0cf720 con 0x7f33c41026d0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.227+0000 7f33c2ffd640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f33b00a3300 0x7f33b00a57c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f33c4101b70 tx=0x7f33b400a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:36.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.229+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33bc09c090 con 0x7f33c41026d0 2024-09-19T09:02:36.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:36 smithi184 ceph-mon[35007]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:36.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:36 smithi184 ceph-mon[35007]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:36.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.402+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 --> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f33c4062630 con 0x7f33b00a3300 2024-09-19T09:02:36.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.404+0000 7f33c8a27640 1 -- 172.21.15.83:0/2443036573 <== mgr.14150 v2:172.21.15.83:6800/2542755280 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f33c4062630 con 0x7f33b00a3300 2024-09-19T09:02:36.404 INFO:teuthology.orchestra.run.smithi083.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:02:36.404 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040148400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:02:36.404 INFO:teuthology.orchestra.run.smithi083.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:02:36.405 INFO:teuthology.orchestra.run.smithi083.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:02:36.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f33b00a3300 msgr2=0x7f33b00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f33b00a3300 0x7f33b00a57c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f33c4101b70 tx=0x7f33b400a5e0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 msgr2=0x7f33c419f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 0x7f33c419f3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00b970 tx=0x7f33bc00be30 comp rx=0 tx=0).stop 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 shutdown_connections 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f33b00a3300 0x7f33b00a57c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33c41026d0 0x7f33c419f3f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33c4101d10 0x7f33c4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 --2- 172.21.15.83:0/2443036573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c4100b10 0x7f33c4197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 >> 172.21.15.83:0/2443036573 conn(0x7f33c40fc2a0 msgr2=0x7f33c41050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 shutdown_connections 2024-09-19T09:02:36.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:36.406+0000 7f33c9a29640 1 -- 172.21.15.83:0/2443036573 wait complete. 2024-09-19T09:02:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:36 smithi122 ceph-mon[34247]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:36.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:36 smithi122 ceph-mon[34247]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:02:37.232 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:02:37.240 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:02:37.240 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:02:38.108 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:38.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:38 smithi083 ceph-mon[30926]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:38.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:38 smithi083 ceph-mon[30926]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:38.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:38 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:38 smithi184 ceph-mon[35007]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:38 smithi184 ceph-mon[35007]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:38 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:38 smithi122 ceph-mon[34247]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:38.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:38 smithi122 ceph-mon[34247]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T09:02:38.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:38 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:38.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1800418124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f41026d0 msgr2=0x7fc7f4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:38.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1800418124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f41026d0 0x7fc7f4108f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009900 tx=0x7fc7ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:02:38.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1800418124 shutdown_connections 2024-09-19T09:02:38.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1800418124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f41026d0 0x7fc7f4108f60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1800418124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4101d10 0x7fc7f4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1800418124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f4100b10 0x7fc7f4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1800418124 >> 172.21.15.83:0/1800418124 conn(0x7fc7f40fc2a0 msgr2=0x7fc7f40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1800418124 shutdown_connections 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1800418124 wait complete. 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 Processor -- start 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.601+0000 7fc7fb4d8640 1 -- start start 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4100b10 0x7fc7f4104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 0x7fc7f41030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41026d0 0x7fc7f4103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f410c640 con 0x7fc7f4101d10 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f410c4c0 con 0x7fc7f41026d0 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f410c7c0 con 0x7fc7f4100b10 2024-09-19T09:02:38.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 0x7fc7f41030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 0x7fc7f41030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39944/0 (socket says 172.21.15.83:39944) 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 -- 172.21.15.83:0/1820911735 learned_addr learned my addr 172.21.15.83:0/1820911735 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f9274640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4100b10 0x7fc7f4104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f9a75640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41026d0 0x7fc7f4103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 -- 172.21.15.83:0/1820911735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4100b10 msgr2=0x7fc7f4104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4100b10 0x7fc7f4104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 -- 172.21.15.83:0/1820911735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41026d0 msgr2=0x7fc7f4103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41026d0 0x7fc7f4103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 -- 172.21.15.83:0/1820911735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f4103ef0 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7f8a73640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 0x7fc7f41030f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800d770 tx=0x7fc7e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8017070 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7e80054d0 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f41a1f70 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.602+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8004cf0 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.603+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f41a23d0 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.603+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f41a2600 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.605+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc7e8004e90 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.605+0000 7fc7e67fc640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7e00a3350 0x7fc7e00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.605+0000 7fc7f9274640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7e00a3350 0x7fc7e00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.605+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc7e80cfae0 con 0x7fc7f4101d10 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.606+0000 7fc7f9274640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7e00a3350 0x7fc7e00a5810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4101b70 tx=0x7fc7f0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:38.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.609+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7e809bd70 con 0x7fc7f4101d10 2024-09-19T09:02:38.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.848+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc7f41a28f0 con 0x7fc7f4101d10 2024-09-19T09:02:38.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.848+0000 7fc7e67fc640 1 -- 172.21.15.83:0/1820911735 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3136 (secure 0 0 0) 0x7fc7e80a0070 con 0x7fc7f4101d10 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:e29 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:btime 2024-09-19T09:01:17:195983+0000 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:legacy client fscid: 1 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:fs_name cephfs 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 29 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-09-19T09:00:37.699557+0000 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:modified 2024-09-19T09:01:16.785988+0000 2024-09-19T09:02:38.849 INFO:teuthology.orchestra.run.smithi083.stdout:tableserver 0 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:root 0 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:session_timeout 300 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:session_autoclose 300 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:max_file_size 1099511627776 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:max_xattr_size 65536 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:required_client_features {} 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:last_failure 0 2024-09-19T09:02:38.853 INFO:teuthology.orchestra.run.smithi083.stdout:last_failure_osd_epoch 0 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:max_mds 5 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:in 0,1,2,3,4 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:up {0=24476,1=24445,2=24443,3=24430,4=14583} 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:failed 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:damaged 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:stopped 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:data_pools [3,4] 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:metadata_pool 2 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:inline_data disabled 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:balancer 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:bal_rank_mask -1 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:standby_count_wanted 0 2024-09-19T09:02:38.854 INFO:teuthology.orchestra.run.smithi083.stdout:qdb_cluster leader: 24476 members: 14583,24476,24430,24443,24445 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b{0:24476} state up:active seq 4 addr [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.f{0:24424} state up:standby-replay seq 1 addr [v2:172.21.15.184:6834/1361922279,v1:172.21.15.184:6835/1361922279] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.i{1:24445} state up:active seq 15 addr [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.e{1:24416} state up:standby-replay seq 1 addr [v2:172.21.15.122:6834/2324915489,v1:172.21.15.122:6835/2324915489] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.h{2:24443} state up:active seq 16 addr [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.l{2:24394} state up:standby-replay seq 1 addr [v2:172.21.15.184:6832/2584272411,v1:172.21.15.184:6833/2584272411] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c{3:24430} state up:active seq 17 addr [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.k{3:24392} state up:standby-replay seq 1 addr [v2:172.21.15.122:6832/3460261556,v1:172.21.15.122:6833/3460261556] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a{4:14583} state up:active seq 14 addr [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.g{4:14577} state up:standby-replay seq 1 addr [v2:172.21.15.83:6838/37046716,v1:172.21.15.83:6839/37046716] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:Standby daemons: 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:38.855 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.j{-1:14508} state up:standby seq 1 addr [v2:172.21.15.83:6834/3427826085,v1:172.21.15.83:6835/3427826085] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.856 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d{-1:14520} state up:standby seq 1 addr [v2:172.21.15.83:6836/1285159931,v1:172.21.15.83:6837/1285159931] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:02:38.856 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:02:38.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7e00a3350 msgr2=0x7fc7e00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:38.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7e00a3350 0x7fc7e00a5810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4101b70 tx=0x7fc7f0009500 comp rx=0 tx=0).stop 2024-09-19T09:02:38.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 msgr2=0x7fc7f41030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:38.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 0x7fc7f41030f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800d770 tx=0x7fc7e800dc30 comp rx=0 tx=0).stop 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 shutdown_connections 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fc7e00a3350 0x7fc7e00a5810 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7f41026d0 0x7fc7f4103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f4101d10 0x7fc7f41030f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 --2- 172.21.15.83:0/1820911735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4100b10 0x7fc7f4104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 >> 172.21.15.83:0/1820911735 conn(0x7fc7f40fc2a0 msgr2=0x7fc7f406a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 shutdown_connections 2024-09-19T09:02:38.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:38.851+0000 7fc7fb4d8640 1 -- 172.21.15.83:0/1820911735 wait complete. 2024-09-19T09:02:39.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:02:39.818 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:39.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:39 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:39 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1820911735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:39.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:39 smithi184 ceph-mon[35007]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:39.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.941 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.941 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.941 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:39 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.941 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:39 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1820911735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:39.941 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:39 smithi083 ceph-mon[30926]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:39 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:39 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1820911735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:39.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:39 smithi122 ceph-mon[34247]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:02:40.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 -- 172.21.15.83:0/1721851145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10741037c0 msgr2=0x7f107410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 --2- 172.21.15.83:0/1721851145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10741037c0 0x7f107410a050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f106c009ca0 tx=0x7f106c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 -- 172.21.15.83:0/1721851145 shutdown_connections 2024-09-19T09:02:40.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 --2- 172.21.15.83:0/1721851145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10741037c0 0x7f107410a050 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 --2- 172.21.15.83:0/1721851145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1074102e00 0x7f1074103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 --2- 172.21.15.83:0/1721851145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1074101c00 0x7f1074102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 -- 172.21.15.83:0/1721851145 >> 172.21.15.83:0/1721851145 conn(0x7f10740fd390 msgr2=0x7f10740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 -- 172.21.15.83:0/1721851145 shutdown_connections 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.327+0000 7f1079829640 1 -- 172.21.15.83:0/1721851145 wait complete. 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 Processor -- start 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 -- start start 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1074101c00 0x7f1074197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 0x7f1074198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10741037c0 0x7f107419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f107410d710 con 0x7f1074102e00 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f107410d590 con 0x7f1074101c00 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1079829640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f107410d890 con 0x7f10741037c0 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f10727fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 0x7f1074198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f10727fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 0x7f1074198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57668/0 (socket says 172.21.15.83:57668) 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f10727fc640 1 -- 172.21.15.83:0/1456855559 learned_addr learned my addr 172.21.15.83:0/1456855559 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.328+0000 7f1072ffd640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1074101c00 0x7f1074197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10737fe640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10741037c0 0x7f107419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10727fc640 1 -- 172.21.15.83:0/1456855559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10741037c0 msgr2=0x7f107419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10727fc640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10741037c0 0x7f107419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10727fc640 1 -- 172.21.15.83:0/1456855559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1074101c00 msgr2=0x7f1074197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10727fc640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1074101c00 0x7f1074197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10727fc640 1 -- 172.21.15.83:0/1456855559 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107419f9f0 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10737fe640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10741037c0 0x7f107419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f10727fc640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 0x7f1074198300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f106800e9f0 tx=0x7f106800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106800cd80 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10680108e0 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068018920 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107419fce0 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.329+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10741a01c0 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.330+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1074109050 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.331+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1068010a90 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.332+0000 7f1078827640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f105c0a3300 0x7f105c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.332+0000 7f1072ffd640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f105c0a3300 0x7f105c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.332+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f10680d0180 con 0x7f1074102e00 2024-09-19T09:02:40.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.332+0000 7f1072ffd640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f105c0a3300 0x7f105c0a57c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1074102c60 tx=0x7f106400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.336+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f106809c9e0 con 0x7f1074102e00 2024-09-19T09:02:40.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.511+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1074062e20 con 0x7f1074102e00 2024-09-19T09:02:40.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.512+0000 7f1078827640 1 -- 172.21.15.83:0/1456855559 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5608 (secure 0 0 0) 0x7f106809c2e0 con 0x7f1074102e00 2024-09-19T09:02:40.512 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 89 2024-09-19T09:02:40.512 INFO:teuthology.orchestra.run.smithi083.stdout:fsid 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-09-19T08:52:50.113301+0000 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:modified 2024-09-19T09:01:44.991185+0000 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:crush_version 27 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:full_ratio 0.95 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:backfillfull_ratio 0.9 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:nearfull_ratio 0.85 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:require_min_compat_client luminous 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:min_compat_client luminous 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:require_osd_release squid 2024-09-19T09:02:40.513 INFO:teuthology.orchestra.run.smithi083.stdout:stretch_mode_enabled false 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:max_osd 12 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6802/2608393780,v1:172.21.15.83:6803/2608393780] [v2:172.21.15.83:6804/2608393780,v1:172.21.15.83:6805/2608393780] exists,up 4d0c1021-57d7-471d-830e-751d6c8d2375 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 up in weight 1 up_from 12 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/3677858839,v1:172.21.15.122:6801/3677858839] [v2:172.21.15.122:6802/3677858839,v1:172.21.15.122:6803/3677858839] exists,up d3a22d9c-ed3c-4f83-95cd-7801d8da969d 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 up in weight 1 up_from 16 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/612727003,v1:172.21.15.184:6801/612727003] [v2:172.21.15.184:6802/612727003,v1:172.21.15.184:6803/612727003] exists,up 886ac026-4d30-4180-af0e-945bc38124de 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 up in weight 1 up_from 23 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6810/261647633,v1:172.21.15.83:6811/261647633] [v2:172.21.15.83:6812/261647633,v1:172.21.15.83:6813/261647633] exists,up fea364e4-e588-486f-8d83-113e0a7f5b49 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 up in weight 1 up_from 30 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/2534293104,v1:172.21.15.122:6809/2534293104] [v2:172.21.15.122:6810/2534293104,v1:172.21.15.122:6811/2534293104] exists,up c716b030-b753-495f-af07-bfe38073eedc 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 up in weight 1 up_from 36 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/2450970045,v1:172.21.15.184:6809/2450970045] [v2:172.21.15.184:6810/2450970045,v1:172.21.15.184:6811/2450970045] exists,up afd43e53-08bc-4a58-b655-f00db3aa2b92 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 up in weight 1 up_from 43 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6818/1892974872,v1:172.21.15.83:6819/1892974872] [v2:172.21.15.83:6820/1892974872,v1:172.21.15.83:6821/1892974872] exists,up bdbae412-c690-425e-ac5e-96d1481a5463 2024-09-19T09:02:40.514 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 up in weight 1 up_from 48 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/1549732923,v1:172.21.15.122:6817/1549732923] [v2:172.21.15.122:6818/1549732923,v1:172.21.15.122:6819/1549732923] exists,up f12c9d22-a585-4926-8058-be2ba2ba2fd0 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:osd.8 up in weight 1 up_from 55 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/1048154265,v1:172.21.15.184:6817/1048154265] [v2:172.21.15.184:6818/1048154265,v1:172.21.15.184:6819/1048154265] exists,up 3952f1a9-50b1-4036-94a8-22eb5e763ede 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:osd.9 up in weight 1 up_from 63 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6826/3960303414,v1:172.21.15.83:6827/3960303414] [v2:172.21.15.83:6828/3960303414,v1:172.21.15.83:6829/3960303414] exists,up 814dd884-f3d2-451c-afb6-44ea8e34c75e 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:osd.10 up in weight 1 up_from 68 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/2508026961,v1:172.21.15.122:6825/2508026961] [v2:172.21.15.122:6826/2508026961,v1:172.21.15.122:6827/2508026961] exists,up 1e5cf625-8523-4410-b239-9f05ff594ffa 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:osd.11 up in weight 1 up_from 75 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/1459778997,v1:172.21.15.184:6825/1459778997] [v2:172.21.15.184:6826/1459778997,v1:172.21.15.184:6827/1459778997] exists,up 617cb685-6467-46dc-95a8-9e7cace13cb9 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 2.c [2,4] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 2.10 [8,11] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.2 [3,9] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.3 [4,9] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.3c [4,9] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.10 [9,10] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.13 [9,8] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.17 [9,8] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.1a [5,8] 2024-09-19T09:02:40.515 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/1998970001 expires 2024-09-20T08:53:42.831703+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/1883694223 expires 2024-09-20T08:53:42.831703+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/3215219814 expires 2024-09-20T08:53:42.831703+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/4071352347 expires 2024-09-20T08:53:42.831703+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/4197257925 expires 2024-09-20T08:53:19.429460+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/4167999844 expires 2024-09-20T08:53:19.429460+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/3719562585 expires 2024-09-20T08:53:19.429460+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/1883694223 expires 2024-09-20T08:53:42.831703+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/3693558817 expires 2024-09-20T08:53:19.429460+0000 2024-09-19T09:02:40.516 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/3693558817 expires 2024-09-20T08:53:19.429460+0000 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f105c0a3300 msgr2=0x7f105c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f105c0a3300 0x7f105c0a57c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1074102c60 tx=0x7f106400b390 comp rx=0 tx=0).stop 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 msgr2=0x7f1074198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 0x7f1074198300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f106800e9f0 tx=0x7f106800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 shutdown_connections 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f105c0a3300 0x7f105c0a57c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10741037c0 0x7f107419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1074102e00 0x7f1074198300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 --2- 172.21.15.83:0/1456855559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1074101c00 0x7f1074197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.514+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 >> 172.21.15.83:0/1456855559 conn(0x7f10740fd390 msgr2=0x7f1074106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.515+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 shutdown_connections 2024-09-19T09:02:40.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:40.515+0000 7f1079829640 1 -- 172.21.15.83:0/1456855559 wait complete. 2024-09-19T09:02:40.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:40.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:40.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:40.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:40.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:40 smithi083 ceph-mon[30926]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:40.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:40 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1456855559' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:02:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:41.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:41.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:40 smithi184 ceph-mon[35007]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:41.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:40 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1456855559' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:02:41.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:41.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:41.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:41.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:41.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:40 smithi122 ceph-mon[34247]: from='mgr.14150 172.21.15.83:0/3777440541' entity='mgr.x' 2024-09-19T09:02:41.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:40 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1456855559' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:02:41.246 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:02:41.257 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:41.504 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:41.920 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:41 smithi083 ceph-mon[30926]: pgmap v348: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:42.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 -- 172.21.15.83:0/4110859150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc106f10 msgr2=0x7fd1dc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 --2- 172.21.15.83:0/4110859150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc106f10 0x7fd1dc10ea90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009ca0 tx=0x7fd1d402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 -- 172.21.15.83:0/4110859150 shutdown_connections 2024-09-19T09:02:42.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 --2- 172.21.15.83:0/4110859150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc106f10 0x7fd1dc10ea90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 --2- 172.21.15.83:0/4110859150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1dc102790 0x7fd1dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 --2- 172.21.15.83:0/4110859150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc101de0 0x7fd1dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 -- 172.21.15.83:0/4110859150 >> 172.21.15.83:0/4110859150 conn(0x7fd1dc0fd8c0 msgr2=0x7fd1dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:42.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 -- 172.21.15.83:0/4110859150 shutdown_connections 2024-09-19T09:02:42.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.998+0000 7fd1e2802640 1 -- 172.21.15.83:0/4110859150 wait complete. 2024-09-19T09:02:42.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 Processor -- start 2024-09-19T09:02:42.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 -- start start 2024-09-19T09:02:42.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 0x7fd1dc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1dc102790 0x7fd1dc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc106f10 0x7fd1dc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc111e40 con 0x7fd1dc101de0 2024-09-19T09:02:42.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc111cc0 con 0x7fd1dc106f10 2024-09-19T09:02:42.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1e2802640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc111fc0 con 0x7fd1dc102790 2024-09-19T09:02:42.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:41.999+0000 7fd1dbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 0x7fd1dc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 0x7fd1dc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57682/0 (socket says 172.21.15.83:57682) 2024-09-19T09:02:42.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 -- 172.21.15.83:0/1002631258 learned_addr learned my addr 172.21.15.83:0/1002631258 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:42.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1e0d9f640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc106f10 0x7fd1dc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1db7fe640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1dc102790 0x7fd1dc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 -- 172.21.15.83:0/1002631258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1dc102790 msgr2=0x7fd1dc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1dc102790 0x7fd1dc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 -- 172.21.15.83:0/1002631258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc106f10 msgr2=0x7fd1dc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc106f10 0x7fd1dc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 -- 172.21.15.83:0/1002631258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc19d3b0 con 0x7fd1dc101de0 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1e0d9f640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc106f10 0x7fd1dc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1dbfff640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 0x7fd1dc198400 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c890 tx=0x7fd1cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc004220 con 0x7fd1dc101de0 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1cc0043c0 con 0x7fd1dc101de0 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1dc19d6a0 con 0x7fd1dc101de0 2024-09-19T09:02:42.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc004a00 con 0x7fd1dc101de0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.000+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1dc1a4f80 con 0x7fd1dc101de0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.001+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1dc1021c0 con 0x7fd1dc101de0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.002+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd1cc004ba0 con 0x7fd1dc101de0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.003+0000 7fd1d97fa640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd1c40a32d0 0x7fd1c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.003+0000 7fd1db7fe640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd1c40a32d0 0x7fd1c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.003+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd1cc0cffa0 con 0x7fd1dc101de0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.004+0000 7fd1db7fe640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd1c40a32d0 0x7fd1c40a5790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ffe30 tx=0x7fd1d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.006+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd1cc014030 con 0x7fd1dc101de0 2024-09-19T09:02:42.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:41 smithi184 ceph-mon[35007]: pgmap v348: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:42.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.208+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1dc10a1b0 con 0x7fd1dc101de0 2024-09-19T09:02:42.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.209+0000 7fd1d97fa640 1 -- 172.21.15.83:0/1002631258 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7fd1cc09c800 con 0x7fd1dc101de0 2024-09-19T09:02:42.210 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:42.210 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"btime":"2024-09-19T09:01:17:195983+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:01:16.785988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[14583,24476,24430,24443,24445]},"id":1}]} 2024-09-19T09:02:42.210 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:02:42.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:41 smithi122 ceph-mon[34247]: pgmap v348: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:02:42.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd1c40a32d0 msgr2=0x7fd1c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd1c40a32d0 0x7fd1c40a5790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ffe30 tx=0x7fd1d0008040 comp rx=0 tx=0).stop 2024-09-19T09:02:42.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 msgr2=0x7fd1dc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 0x7fd1dc198400 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c890 tx=0x7fd1cc00cd50 comp rx=0 tx=0).stop 2024-09-19T09:02:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 shutdown_connections 2024-09-19T09:02:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fd1c40a32d0 0x7fd1c40a5790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1dc106f10 0x7fd1dc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1dc102790 0x7fd1dc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 --2- 172.21.15.83:0/1002631258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1dc101de0 0x7fd1dc198400 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 >> 172.21.15.83:0/1002631258 conn(0x7fd1dc0fd8c0 msgr2=0x7fd1dc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:42.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 shutdown_connections 2024-09-19T09:02:42.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:42.211+0000 7fd1e2802640 1 -- 172.21.15.83:0/1002631258 wait complete. 2024-09-19T09:02:42.868 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:42 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1002631258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:42.911 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:43.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:42 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1002631258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:43.168 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:43.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:42 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1002631258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:43.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 -- 172.21.15.83:0/14222119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac102570 msgr2=0x7f17ac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 --2- 172.21.15.83:0/14222119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac102570 0x7f17ac1029b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009ca0 tx=0x7f17a002a950 comp rx=0 tx=0).stop 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 -- 172.21.15.83:0/14222119 shutdown_connections 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 --2- 172.21.15.83:0/14222119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ac102ef0 0x7f17ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 --2- 172.21.15.83:0/14222119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac102570 0x7f17ac1029b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 --2- 172.21.15.83:0/14222119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17ac100e20 0x7f17ac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 -- 172.21.15.83:0/14222119 >> 172.21.15.83:0/14222119 conn(0x7f17ac0fc7d0 msgr2=0x7f17ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 -- 172.21.15.83:0/14222119 shutdown_connections 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 -- 172.21.15.83:0/14222119 wait complete. 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 Processor -- start 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.642+0000 7f17b174b640 1 -- start start 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 0x7f17ac199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17ac102570 0x7f17ac1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ac102ef0 0x7f17ac1a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac110e30 con 0x7f17ac100e20 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac110cb0 con 0x7f17ac102ef0 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac110fb0 con 0x7f17ac102570 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 0x7f17ac199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 0x7f17ac199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57694/0 (socket says 172.21.15.83:57694) 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 -- 172.21.15.83:0/4265808583 learned_addr learned my addr 172.21.15.83:0/4265808583 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aa7fc640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17ac102570 0x7f17ac1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17ab7fe640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ac102ef0 0x7f17ac1a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 -- 172.21.15.83:0/4265808583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17ac102570 msgr2=0x7f17ac1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17ac102570 0x7f17ac1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 -- 172.21.15.83:0/4265808583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ac102ef0 msgr2=0x7f17ac1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ac102ef0 0x7f17ac1a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 -- 172.21.15.83:0/4265808583 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac1a4830 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17aaffd640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 0x7f17ac199270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d770 tx=0x7f17a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4017070 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17a40054d0 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004cf0 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.643+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac1a4a00 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.644+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac1a4ec0 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.644+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ac101200 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.646+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f17a4004e90 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.646+0000 7f1793fff640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f17940a32d0 0x7f17940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.646+0000 7f17aa7fc640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f17940a32d0 0x7f17940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.646+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f17a40cfc50 con 0x7f17ac100e20 2024-09-19T09:02:43.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.647+0000 7f17aa7fc640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f17940a32d0 0x7f17940a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17ac06aac0 tx=0x7f17a0004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.649+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f17a409c4b0 con 0x7f17ac100e20 2024-09-19T09:02:43.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.774+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f17a4098420 con 0x7f17ac100e20 2024-09-19T09:02:43.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.854+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17ac109090 con 0x7f17ac100e20 2024-09-19T09:02:43.854 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:43 smithi083 ceph-mon[30926]: pgmap v349: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:43.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.855+0000 7f1793fff640 1 -- 172.21.15.83:0/4265808583 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f17a40c9df0 con 0x7f17ac100e20 2024-09-19T09:02:43.855 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:43.855 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":29,"btime":"2024-09-19T09:01:17:195983+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:01:16.785988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[14583,24476,24430,24443,24445]},"id":1}]} 2024-09-19T09:02:43.856 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 29 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f17940a32d0 msgr2=0x7f17940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f17940a32d0 0x7f17940a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17ac06aac0 tx=0x7f17a0004a60 comp rx=0 tx=0).stop 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 msgr2=0x7f17ac199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 0x7f17ac199270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d770 tx=0x7f17a400dc30 comp rx=0 tx=0).stop 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 shutdown_connections 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f17940a32d0 0x7f17940a5790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17ac102ef0 0x7f17ac1a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17ac102570 0x7f17ac1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 --2- 172.21.15.83:0/4265808583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17ac100e20 0x7f17ac199270 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 >> 172.21.15.83:0/4265808583 conn(0x7f17ac0fc7d0 msgr2=0x7f17ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 shutdown_connections 2024-09-19T09:02:43.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:43.857+0000 7f17b174b640 1 -- 172.21.15.83:0/4265808583 wait complete. 2024-09-19T09:02:44.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:43 smithi184 ceph-mon[35007]: pgmap v349: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:44.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:43 smithi122 ceph-mon[34247]: pgmap v349: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:02:44.568 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:44.812 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:44.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:44 smithi083 ceph-mon[30926]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T09:02:44.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:44 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4265808583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:45.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:44 smithi184 ceph-mon[35007]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T09:02:45.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:44 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4265808583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:45.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:44 smithi122 ceph-mon[34247]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T09:02:45.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:44 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4265808583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2968964342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 msgr2=0x7f1ed8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2968964342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed8101200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009900 tx=0x7f1ecc02a480 comp rx=0 tx=0).stop 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2968964342 shutdown_connections 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2968964342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ed8102ef0 0x7f1ed810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2968964342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed8102570 0x7f1ed81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2968964342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed8101200 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2968964342 >> 172.21.15.83:0/2968964342 conn(0x7f1ed80fc7d0 msgr2=0x7f1ed80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2968964342 shutdown_connections 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.276+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2968964342 wait complete. 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 Processor -- start 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 -- start start 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed8102570 0x7f1ed81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ed8102ef0 0x7f1ed81a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8110ea0 con 0x7f1ed8100e20 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8110d20 con 0x7f1ed8102ef0 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edf1f6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8111020 con 0x7f1ed8102570 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed81992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57710/0 (socket says 172.21.15.83:57710) 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 -- 172.21.15.83:0/2004112425 learned_addr learned my addr 172.21.15.83:0/2004112425 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1ed7fff640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed8102570 0x7f1ed81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 -- 172.21.15.83:0/2004112425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed8102570 msgr2=0x7f1ed81997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed8102570 0x7f1ed81997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 -- 172.21.15.83:0/2004112425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ed8102ef0 msgr2=0x7f1ed81a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ed8102ef0 0x7f1ed81a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 -- 172.21.15.83:0/2004112425 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81a4870 con 0x7f1ed8100e20 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.277+0000 7f1edcf92640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed81992b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc006010 tx=0x7f1ecc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.278+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc03f070 con 0x7f1ed8100e20 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.278+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ecc03bd20 con 0x7f1ed8100e20 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.278+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81a4a40 con 0x7f1ed8100e20 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.278+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc035030 con 0x7f1ed8100e20 2024-09-19T09:02:45.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.278+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81a4ef0 con 0x7f1ed8100e20 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.279+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8101200 con 0x7f1ed8100e20 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.280+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ecc042070 con 0x7f1ed8100e20 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.281+0000 7f1ed5ffb640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ec80a32c0 0x7f1ec80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.281+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1ecc0f0ad0 con 0x7f1ed8100e20 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.281+0000 7f1ed7fff640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ec80a32c0 0x7f1ec80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.281+0000 7f1ed7fff640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ec80a32c0 0x7f1ec80a5780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806aac0 tx=0x7f1ec4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:45.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.284+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ecc0bd490 con 0x7f1ed8100e20 2024-09-19T09:02:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.457+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ed8109090 con 0x7f1ed8100e20 2024-09-19T09:02:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.459+0000 7f1ed5ffb640 1 -- 172.21.15.83:0/2004112425 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24765 (secure 0 0 0) 0x7f1ecc0bcd90 con 0x7f1ed8100e20 2024-09-19T09:02:45.459 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:02:45.460 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":89,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:01:44.991185+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:45.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ec80a32c0 msgr2=0x7f1ec80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ec80a32c0 0x7f1ec80a5780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806aac0 tx=0x7f1ec4008040 comp rx=0 tx=0).stop 2024-09-19T09:02:45.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 msgr2=0x7f1ed81992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed81992b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc006010 tx=0x7f1ecc003d50 comp rx=0 tx=0).stop 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 shutdown_connections 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f1ec80a32c0 0x7f1ec80a5780 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ed8102ef0 0x7f1ed81a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed8102570 0x7f1ed81997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 --2- 172.21.15.83:0/2004112425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ed8100e20 0x7f1ed81992b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 >> 172.21.15.83:0/2004112425 conn(0x7f1ed80fc7d0 msgr2=0x7f1ed80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 shutdown_connections 2024-09-19T09:02:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:45.461+0000 7f1edf1f6640 1 -- 172.21.15.83:0/2004112425 wait complete. 2024-09-19T09:02:46.050 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:45 smithi083 ceph-mon[30926]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:02:46.050 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:45 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2004112425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:46.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:00:37.699557+0000', 'modified': '2024-09-19T09:01:16.785988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24445, 'mds_2': 24443, 'mds_3': 24430, 'mds_4': 14583}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.83:6839/37046716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6838', 'nonce': 37046716}, {'type': 'v1', 'addr': '172.21.15.83:6839', 'nonce': 37046716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14583': {'gid': 14583, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.83:6841/2224605516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6840', 'nonce': 2224605516}, {'type': 'v1', 'addr': '172.21.15.83:6841', 'nonce': 2224605516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/3460261556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 3460261556}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 3460261556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/2584272411', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 2584272411}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 2584272411}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6835/2324915489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2324915489}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 2324915489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/1361922279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 1361922279}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 1361922279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.184:6837/236760278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 236760278}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 236760278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.122:6837/3109792741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 3109792741}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3109792741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.184:6839/1323973245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 1323973245}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 1323973245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.122:6839/1686011933', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 1686011933}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 1686011933}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [14583, 24476, 24430, 24443, 24445]} 2024-09-19T09:02:46.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:02:46.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T09:02:46.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:45 smithi184 ceph-mon[35007]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:02:46.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:45 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2004112425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:46.210 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:45 smithi122 ceph-mon[34247]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:02:46.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:45 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2004112425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:46.331 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 -- 172.21.15.83:0/1744349816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c106f10 msgr2=0x7f950c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 --2- 172.21.15.83:0/1744349816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c106f10 0x7f950c10ea90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9504009ca0 tx=0x7f950402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 -- 172.21.15.83:0/1744349816 shutdown_connections 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 --2- 172.21.15.83:0/1744349816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c106f10 0x7f950c10ea90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 --2- 172.21.15.83:0/1744349816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c102790 0x7f950c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 --2- 172.21.15.83:0/1744349816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c101de0 0x7f950c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 -- 172.21.15.83:0/1744349816 >> 172.21.15.83:0/1744349816 conn(0x7f950c0fd8c0 msgr2=0x7f950c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 -- 172.21.15.83:0/1744349816 shutdown_connections 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 -- 172.21.15.83:0/1744349816 wait complete. 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.819+0000 7f9514345640 1 Processor -- start 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 -- start start 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 0x7f950c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c102790 0x7f950c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c106f10 0x7f950c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f950c111ec0 con 0x7f950c101de0 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f950c111d40 con 0x7f950c102790 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f9514345640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f950c112040 con 0x7f950c106f10 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 0x7f950c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 0x7f950c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57728/0 (socket says 172.21.15.83:57728) 2024-09-19T09:02:46.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 -- 172.21.15.83:0/2541490436 learned_addr learned my addr 172.21.15.83:0/2541490436 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95118e0640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c102790 0x7f950c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 -- 172.21.15.83:0/2541490436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c106f10 msgr2=0x7f950c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95128e2640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c106f10 0x7f950c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c106f10 0x7f950c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 -- 172.21.15.83:0/2541490436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c102790 msgr2=0x7f950c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c102790 0x7f950c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 -- 172.21.15.83:0/2541490436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c19d430 con 0x7f950c101de0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95118e0640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c102790 0x7f950c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95128e2640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c106f10 0x7f950c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f95120e1640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 0x7f950c198480 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f950800b4a0 tx=0x7f950800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.820+0000 7f94ff7fe640 1 -- 172.21.15.83:0/2541490436 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508014070 con 0x7f950c101de0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.821+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c19d720 con 0x7f950c101de0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.821+0000 7f94ff7fe640 1 -- 172.21.15.83:0/2541490436 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9508010ac0 con 0x7f950c101de0 2024-09-19T09:02:46.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.821+0000 7f94ff7fe640 1 -- 172.21.15.83:0/2541490436 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508017c30 con 0x7f950c101de0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.821+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c1a5000 con 0x7f950c101de0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.823+0000 7f94ff7fe640 1 -- 172.21.15.83:0/2541490436 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9508017070 con 0x7f950c101de0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.823+0000 7f951671e740 1 Processor -- start 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.823+0000 7f951671e740 1 -- start start 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f951671e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816c39d0 0x55bb816c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f951671e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f951671e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816cebb0 0x55bb816d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f951671e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bb8162a090 con 0x55bb816c42f0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f951671e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb815d1a70 con 0x55bb816cebb0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f951671e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bb81626050 con 0x55bb816c39d0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57740/0 (socket says 172.21.15.83:57740) 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 -- 172.21.15.83:0/4112362672 learned_addr learned my addr 172.21.15.83:0/4112362672 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:46.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f94ff7fe640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f94f80a3240 0x7f94f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95128e2640 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816c39d0 0x55bb816c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95118e0640 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816cebb0 0x55bb816d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f94ff7fe640 1 -- 172.21.15.83:0/2541490436 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f95080cf3f0 con 0x7f950c101de0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 -- 172.21.15.83:0/4112362672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816c39d0 msgr2=0x55bb816c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95128e2640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f94f80a3240 0x7f94f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816c39d0 0x55bb816c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 -- 172.21.15.83:0/4112362672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816cebb0 msgr2=0x55bb816d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816cebb0 0x55bb816d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95120e1640 1 -- 172.21.15.83:0/4112362672 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb815de130 con 0x55bb816c42f0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.824+0000 7f95118e0640 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816cebb0 0x55bb816d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f95120e1640 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816ce670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f950809b3b0 tx=0x7f95080047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535825e2b2df78b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f94fcdea640 1 -- 172.21.15.83:0/4112362672 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950801e070 con 0x55bb816c42f0 2024-09-19T09:02:46.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f94fcdea640 1 -- 172.21.15.83:0/4112362672 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f950809bdb0 con 0x55bb816c42f0 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f94fcdea640 1 -- 172.21.15.83:0/4112362672 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080ccca0 con 0x55bb816c42f0 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 -- 172.21.15.83:0/4112362672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 msgr2=0x55bb816ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816ce670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f950809b3b0 tx=0x7f95080047d0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f95128e2640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f94f80a3240 0x7f94f80a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9504009a60 tx=0x7f950402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 -- 172.21.15.83:0/4112362672 shutdown_connections 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816cebb0 0x55bb816d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816ce670 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 --2- 172.21.15.83:0/4112362672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816c39d0 0x55bb816c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.825+0000 7f951671e740 1 -- 172.21.15.83:0/4112362672 >> 172.21.15.83:0/4112362672 conn(0x55bb816bff60 msgr2=0x55bb816c0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 -- 172.21.15.83:0/4112362672 shutdown_connections 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 -- 172.21.15.83:0/4112362672 wait complete. 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 -- start start 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 Processor -- start 2024-09-19T09:02:46.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bb816d1780 con 0x55bb816c42f0 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb815e4f20 con 0x55bb816c39d0 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bb816d1900 con 0x55bb816cebb0 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.826+0000 7f951671e740 10 client.0 _ll_register_callbacks cb 0x55bb815ae030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:46.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57754/0 (socket says 172.21.15.83:57754) 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 -- 172.21.15.83:0/1581039057 learned_addr learned my addr 172.21.15.83:0/1581039057 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95120e1640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95128e2640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 -- 172.21.15.83:0/1581039057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 msgr2=0x55bb816cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 -- 172.21.15.83:0/1581039057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 msgr2=0x55bb816ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 -- 172.21.15.83:0/1581039057 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb8139b2b0 con 0x55bb816c42f0 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95128e2640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:46.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95120e1640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f95118e0640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816cb7b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f950000ded0 tx=0x7f950000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7239e1712319bb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f94f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f94f5ffb640 1 -- 172.21.15.83:0/1581039057 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500018070 con 0x55bb816c42f0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f94f5ffb640 1 -- 172.21.15.83:0/1581039057 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f9500014680 con 0x55bb816c42f0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950809bdb0 con 0x55bb816c42f0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f94f5ffb640 1 -- 172.21.15.83:0/1581039057 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9500024050 con 0x55bb816c42f0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f951671e740 10 client.15186 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb816dd100 con 0x55bb816c42f0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.827+0000 7f94f5ffb640 1 -- 172.21.15.83:0/1581039057 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f950809bdb0 con 0x55bb816c42f0 2024-09-19T09:02:46.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f94f5ffb640 1 -- 172.21.15.83:0/1581039057 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9500013ac0 con 0x55bb816c42f0 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f951671e740 10 client.15186 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f951671e740 10 client.15186 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f951671e740 20 client.15186 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f951671e740 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb816df740 0x55bb816e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f951671e740 4 client.15186 mds_command: new command op to 14583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 --> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb81637600 con 0x55bb816df740 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f95120e1640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb816df740 0x55bb816e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f95120e1640 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb816df740 0x55bb816e0bb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=971624a2812824fe server_cookie=8f64a41e73156af2 in_seq=0 out_seq=0 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.828+0000 7f94f5ffb640 10 client.15186 ms_handle_connect on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f94f5ffb640 1 -- 172.21.15.83:0/1581039057 <== mds.4 v2:172.21.15.83:6840/2224605516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb81637600 con 0x55bb816df740 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f94f5ffb640 10 client.15186 handle_command_reply: tid=0 2024-09-19T09:02:46.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 client.15186 shutdown 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 msgr2=0x55bb816cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816cb7b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f950000ded0 tx=0x7f950000f5b0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 shutdown_connections 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816cb7b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb816df740 0x55bb816e0bb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 --2- 172.21.15.83:0/1581039057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f94f5ffb640 0 client.15186 ms_handle_reset on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:46.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 >> 172.21.15.83:0/1581039057 conn(0x55bb816bff60 msgr2=0x55bb816c5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 shutdown_connections 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 1 -- 172.21.15.83:0/1581039057 wait complete. 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.829+0000 7f951671e740 20 client.15186 trim_cache size 0 max 16384 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.846+0000 7f951671e740 1 Processor -- start 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.846+0000 7f951671e740 1 -- start start 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f951671e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 0x55bb816c0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f951671e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c42f0 0x55bb816e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f951671e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816e93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f951671e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bb816deef0 con 0x55bb816c39d0 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f951671e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb816df5c0 con 0x55bb816c42f0 2024-09-19T09:02:46.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f951671e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bb816dfc90 con 0x55bb816cebb0 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 0x55bb816c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 0x55bb816c0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57762/0 (socket says 172.21.15.83:57762) 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 -- 172.21.15.83:0/1194442997 learned_addr learned my addr 172.21.15.83:0/1194442997 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95128e2640 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816e93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95118e0640 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c42f0 0x55bb816e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 -- 172.21.15.83:0/1194442997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 msgr2=0x55bb816e93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816e93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 -- 172.21.15.83:0/1194442997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c42f0 msgr2=0x55bb816e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c42f0 0x55bb816e8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 -- 172.21.15.83:0/1194442997 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb816ce7d0 con 0x55bb816c39d0 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.847+0000 7f95120e1640 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 0x55bb816c0340 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f95080ccbe0 tx=0x7f9508097a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2516cb8162e48e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f94f7fff640 1 -- 172.21.15.83:0/1194442997 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950801e040 con 0x55bb816c39d0 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f94f7fff640 1 -- 172.21.15.83:0/1194442997 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f950809fa60 con 0x55bb816c39d0 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f94f7fff640 1 -- 172.21.15.83:0/1194442997 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508097d20 con 0x55bb816c39d0 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 -- 172.21.15.83:0/1194442997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 msgr2=0x55bb816c0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 0x55bb816c0340 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f95080ccbe0 tx=0x7f9508097a80 comp rx=0 tx=0).stop 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 -- 172.21.15.83:0/1194442997 shutdown_connections 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb816e93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c42f0 0x55bb816e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 --2- 172.21.15.83:0/1194442997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c39d0 0x55bb816c0340 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 -- 172.21.15.83:0/1194442997 >> 172.21.15.83:0/1194442997 conn(0x55bb816bff60 msgr2=0x55bb816ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 -- 172.21.15.83:0/1194442997 shutdown_connections 2024-09-19T09:02:46.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.848+0000 7f951671e740 1 -- 172.21.15.83:0/1194442997 wait complete. 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 -- start start 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 Processor -- start 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816e3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816e4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb81747e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bb816e0a30 con 0x55bb816c42f0 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb816e0360 con 0x55bb816c39d0 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bb816e1100 con 0x55bb816cebb0 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f951671e740 10 client.0 _ll_register_callbacks cb 0x7f950000d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:46.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816e4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57770/0 (socket says 172.21.15.83:57770) 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 -- 172.21.15.83:0/76735799 learned_addr learned my addr 172.21.15.83:0/76735799 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95120e1640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816e3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95128e2640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb81747e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 -- 172.21.15.83:0/76735799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 msgr2=0x55bb81747e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb81747e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 -- 172.21.15.83:0/76735799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 msgr2=0x55bb816e3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816e3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 -- 172.21.15.83:0/76735799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb81748380 con 0x55bb816c42f0 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95128e2640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb81747e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95120e1640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816e3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:46.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f95118e0640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816e4500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9500013ee0 tx=0x7f950001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1775c3010ad43b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.849+0000 7f94f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f94f5ffb640 1 -- 172.21.15.83:0/76735799 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950002c070 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f94f5ffb640 1 -- 172.21.15.83:0/76735799 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f950001ca20 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950809fa60 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f94f5ffb640 1 -- 172.21.15.83:0/76735799 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9500038050 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 10 client.15192 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb81749560 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f94f5ffb640 1 -- 172.21.15.83:0/76735799 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f950809fa60 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f94f5ffb640 1 -- 172.21.15.83:0/76735799 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9500014480 con 0x55bb816c42f0 2024-09-19T09:02:46.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 10 client.15192 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 10 client.15192 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 20 client.15192 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb8174e150 0x55bb8174ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 4 client.15192 mds_command: new command op to 14583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 --> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] -- command(tid 0: {"prefix": "status"}) -- 0x55bb81631b10 con 0x55bb8174e150 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.850+0000 7f95120e1640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb8174e150 0x55bb8174ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f94f5ffb640 10 client.15192 ms_handle_connect on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f95120e1640 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb8174e150 0x55bb8174ce60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae52e405cea7bbbd server_cookie=eb3d3769d3110613 in_seq=0 out_seq=0 2024-09-19T09:02:46.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f94f5ffb640 1 -- 172.21.15.83:0/76735799 <== mds.4 v2:172.21.15.83:6840/2224605516 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bb81631b10 con 0x55bb8174e150 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f94f5ffb640 10 client.15192 handle_command_reply: tid=0 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 client.15192 shutdown 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 msgr2=0x55bb816e4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816e4500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9500013ee0 tx=0x7f950001c410 comp rx=0 tx=0).stop 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 shutdown_connections 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb816cebb0 0x55bb81747e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bb816c42f0 0x55bb816e4500 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.83:6840/2224605516,v1:172.21.15.83:6841/2224605516] conn(0x55bb8174e150 0x55bb8174ce60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 --2- 172.21.15.83:0/76735799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb816c39d0 0x55bb816e3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f94f5ffb640 0 client.15192 ms_handle_reset on v2:172.21.15.83:6840/2224605516 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 >> 172.21.15.83:0/76735799 conn(0x55bb816bff60 msgr2=0x55bb816cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 shutdown_connections 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 1 -- 172.21.15.83:0/76735799 wait complete. 2024-09-19T09:02:46.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.851+0000 7f951671e740 20 client.15192 trim_cache size 0 max 16384 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 4, 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 14583, 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:46.875 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 91.663026010999999, 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 142.12232229899999 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f94f80a3240 msgr2=0x7f94f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f94f80a3240 0x7f94f80a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9504009a60 tx=0x7f950402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 msgr2=0x7f950c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 0x7f950c198480 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f950800b4a0 tx=0x7f950800b960 comp rx=0 tx=0).stop 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 shutdown_connections 2024-09-19T09:02:46.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f94f80a3240 0x7f94f80a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c106f10 0x7f950c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f950c102790 0x7f950c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 --2- 172.21.15.83:0/2541490436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101de0 0x7f950c198480 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 >> 172.21.15.83:0/2541490436 conn(0x7f950c0fd8c0 msgr2=0x7f950c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 shutdown_connections 2024-09-19T09:02:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:46.852+0000 7f9514345640 1 -- 172.21.15.83:0/2541490436 wait complete. 2024-09-19T09:02:47.645 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:02:47.890 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:48.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:47 smithi083 ceph-mon[30926]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:02:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:48 smithi184 ceph-mon[35007]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 -- 172.21.15.83:0/1646125177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc102de0 msgr2=0x7fabcc1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 --2- 172.21.15.83:0/1646125177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc102de0 0x7fabcc1031c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009900 tx=0x7fabbc02a480 comp rx=0 tx=0).stop 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 -- 172.21.15.83:0/1646125177 shutdown_connections 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 --2- 172.21.15.83:0/1646125177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabcc10c180 0x7fabcc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 --2- 172.21.15.83:0/1646125177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabcc103700 0x7fabcc10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 --2- 172.21.15.83:0/1646125177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc102de0 0x7fabcc1031c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 -- 172.21.15.83:0/1646125177 >> 172.21.15.83:0/1646125177 conn(0x7fabcc0fc7a0 msgr2=0x7fabcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 -- 172.21.15.83:0/1646125177 shutdown_connections 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.384+0000 7fabd283d640 1 -- 172.21.15.83:0/1646125177 wait complete. 2024-09-19T09:02:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 Processor -- start 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 -- start start 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabcc102de0 0x7fabcc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabcc103700 0x7fabcc198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 0x7fabcc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc111e20 con 0x7fabcc10c180 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc111ca0 con 0x7fabcc103700 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd283d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc111fa0 con 0x7fabcc102de0 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd0dda640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 0x7fabcc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd0dda640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 0x7fabcc19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57798/0 (socket says 172.21.15.83:57798) 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabd0dda640 1 -- 172.21.15.83:0/3068287179 learned_addr learned my addr 172.21.15.83:0/3068287179 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.385+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabcc103700 0x7fabcc198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabcbfff640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabcc102de0 0x7fabcc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd0dda640 1 -- 172.21.15.83:0/3068287179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabcc102de0 msgr2=0x7fabcc198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd0dda640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabcc102de0 0x7fabcc198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd0dda640 1 -- 172.21.15.83:0/3068287179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabcc103700 msgr2=0x7fabcc198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd0dda640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabcc103700 0x7fabcc198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd0dda640 1 -- 172.21.15.83:0/3068287179 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc19d2e0 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd0dda640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 0x7fabcc19cc00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fabc400cce0 tx=0x7fabc400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabc97fa640 1 -- 172.21.15.83:0/3068287179 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc400f450 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabc97fa640 1 -- 172.21.15.83:0/3068287179 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabc400faa0 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabc97fa640 1 -- 172.21.15.83:0/3068287179 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4018b70 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc19d5d0 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.386+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabcc1a4eb0 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.388+0000 7fabc97fa640 1 -- 172.21.15.83:0/3068287179 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fabc4018d10 con 0x7fabcc10c180 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 Processor -- start 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 -- start start 2024-09-19T09:02:48.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975337db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x555975342670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x555975344fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55597529e090 con 0x5559753379d0 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555975245a70 con 0x5559753382f0 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd4c16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55597529a050 con 0x555975342bb0 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975337db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabc97fa640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fabb40a3240 0x7fabb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975337db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57812/0 (socket says 172.21.15.83:57812) 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 -- 172.21.15.83:0/1082574828 learned_addr learned my addr 172.21.15.83:0/1082574828 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcbfff640 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x555975342670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabd0dda640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fabb40a3240 0x7fabb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 -- 172.21.15.83:0/1082574828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 msgr2=0x555975344fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x555975344fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 -- 172.21.15.83:0/1082574828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 msgr2=0x555975342670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x555975342670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabcb7fe640 1 -- 172.21.15.83:0/1082574828 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555975252130 con 0x5559753379d0 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.389+0000 7fabc97fa640 1 -- 172.21.15.83:0/3068287179 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fabc40d00a0 con 0x7fabcc10c180 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975337db0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fabc000acd0 tx=0x7fabc000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1def3dec13d84c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabb27fc640 1 -- 172.21.15.83:0/1082574828 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0005220 con 0x5559753379d0 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabb27fc640 1 -- 172.21.15.83:0/1082574828 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabc0004c50 con 0x5559753379d0 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabd0dda640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fabb40a3240 0x7fabb40a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fabc4098760 tx=0x7fabc40917e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabb27fc640 1 -- 172.21.15.83:0/1082574828 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0018820 con 0x5559753379d0 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabd4c16740 1 -- 172.21.15.83:0/1082574828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 msgr2=0x555975337db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.390+0000 7fabd4c16740 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975337db0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fabc000acd0 tx=0x7fabc000f790 comp rx=0 tx=0).stop 2024-09-19T09:02:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- 172.21.15.83:0/1082574828 shutdown_connections 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x555975344fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x555975342670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 --2- 172.21.15.83:0/1082574828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975337db0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- 172.21.15.83:0/1082574828 >> 172.21.15.83:0/1082574828 conn(0x555975333f60 msgr2=0x555975334340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- 172.21.15.83:0/1082574828 shutdown_connections 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- 172.21.15.83:0/1082574828 wait complete. 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- start start 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 Processor -- start 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753379d0 0x555975342410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 0x55597533f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597533fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555975345780 con 0x5559753382f0 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555975258f20 con 0x5559753379d0 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555975345900 con 0x555975342bb0 2024-09-19T09:02:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabd4c16740 10 client.0 _ll_register_callbacks cb 0x555975222030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.391+0000 7fabcbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 0x55597533f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 0x55597533f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57826/0 (socket says 172.21.15.83:57826) 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 -- 172.21.15.83:0/284967150 learned_addr learned my addr 172.21.15.83:0/284967150 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753379d0 0x555975342410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597533fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 -- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 msgr2=0x55597533fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597533fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 -- 172.21.15.83:0/284967150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753379d0 msgr2=0x555975342410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753379d0 0x555975342410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 -- 172.21.15.83:0/284967150 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55597500f2b0 con 0x5559753382f0 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753379d0 0x555975342410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabcbfff640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 0x55597533f760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009900 tx=0x7fabbc0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d11c0207ca75e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabab7fe640 1 -- 172.21.15.83:0/284967150 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc035070 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabab7fe640 1 -- 172.21.15.83:0/284967150 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fabbc004240 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc0004c50 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabab7fe640 1 -- 172.21.15.83:0/284967150 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fabbc04d050 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabd4c16740 10 client.15204 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555975351070 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.392+0000 7fabab7fe640 1 -- 172.21.15.83:0/284967150 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabc0004c50 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabab7fe640 1 -- 172.21.15.83:0/284967150 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fabbc044480 con 0x5559753382f0 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabd4c16740 10 client.15204 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabd4c16740 10 client.15204 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabd4c16740 20 client.15204 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabd4c16740 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753536b0 0x555975354b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabd4c16740 4 client.15204 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 --> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559752ab600 con 0x5559753536b0 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753536b0 0x555975354b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753536b0 0x555975354b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d71196b92b39eb38 server_cookie=7be1ee046c1ce21e in_seq=0 out_seq=0 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.393+0000 7fabab7fe640 10 client.15204 ms_handle_connect on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabab7fe640 1 -- 172.21.15.83:0/284967150 <== mds.3 v2:172.21.15.184:6836/236760278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559752ab600 con 0x5559753536b0 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabab7fe640 10 client.15204 handle_command_reply: tid=0 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 client.15204 shutdown 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 msgr2=0x55597533f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 0x55597533f760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009900 tx=0x7fabbc0316d0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 shutdown_connections 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753536b0 0x555975354b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597533fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753382f0 0x55597533f760 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabab7fe640 0 client.15204 ms_handle_reset on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 --2- 172.21.15.83:0/284967150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753379d0 0x555975342410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.394+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 >> 172.21.15.83:0/284967150 conn(0x555975333f60 msgr2=0x555975339c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.395+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 shutdown_connections 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.395+0000 7fabd4c16740 1 -- 172.21.15.83:0/284967150 wait complete. 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.395+0000 7fabd4c16740 20 client.15204 trim_cache size 0 max 16384 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 Processor -- start 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 -- start start 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975354b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x55597535ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597535d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555975352e60 con 0x5559753379d0 2024-09-19T09:02:48.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555975353530 con 0x5559753382f0 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabd4c16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555975353c00 con 0x555975342bb0 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975354b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975354b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57838/0 (socket says 172.21.15.83:57838) 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabcb7fe640 1 -- 172.21.15.83:0/3033801162 learned_addr learned my addr 172.21.15.83:0/3033801162 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabcbfff640 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x55597535ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabcb7fe640 1 -- 172.21.15.83:0/3033801162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 msgr2=0x55597535d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.412+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597535d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabcb7fe640 1 -- 172.21.15.83:0/3033801162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 msgr2=0x55597535ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x55597535ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabcb7fe640 1 -- 172.21.15.83:0/3033801162 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55597533dcb0 con 0x5559753379d0 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabcbfff640 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x55597535ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975354b20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fabc00184b0 tx=0x7fabc0018440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df35412f45c39bad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabb1ffb640 1 -- 172.21.15.83:0/3033801162 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc000a2d0 con 0x5559753379d0 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabb1ffb640 1 -- 172.21.15.83:0/3033801162 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabc000a840 con 0x5559753379d0 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabb1ffb640 1 -- 172.21.15.83:0/3033801162 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0018980 con 0x5559753379d0 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabd4c16740 1 -- 172.21.15.83:0/3033801162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 msgr2=0x555975354b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.413+0000 7fabd4c16740 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975354b20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fabc00184b0 tx=0x7fabc0018440 comp rx=0 tx=0).stop 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- 172.21.15.83:0/3033801162 shutdown_connections 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555975342bb0 0x55597535d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5559753382f0 0x55597535ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 --2- 172.21.15.83:0/3033801162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x555975354b20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- 172.21.15.83:0/3033801162 >> 172.21.15.83:0/3033801162 conn(0x555975333f60 msgr2=0x55597533e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- 172.21.15.83:0/3033801162 shutdown_connections 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- 172.21.15.83:0/3033801162 wait complete. 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- start start 2024-09-19T09:02:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 Processor -- start 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x5559753584d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5559753382f0 0x555975358a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555975342bb0 0x5559753bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5559753549a0 con 0x5559753379d0 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5559753542d0 con 0x555975342bb0 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.414+0000 7fabd4c16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555975355070 con 0x5559753382f0 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabd4c16740 10 client.0 _ll_register_callbacks cb 0x7fabbc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x5559753584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x5559753584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57848/0 (socket says 172.21.15.83:57848) 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 -- 172.21.15.83:0/2575775520 learned_addr learned my addr 172.21.15.83:0/2575775520 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcbfff640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5559753382f0 0x555975358a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 -- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5559753382f0 msgr2=0x555975358a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5559753382f0 0x555975358a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 -- 172.21.15.83:0/2575775520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555975342bb0 msgr2=0x5559753bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555975342bb0 0x5559753bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 -- 172.21.15.83:0/2575775520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559753bc3a0 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcbfff640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5559753382f0 0x555975358a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabcb7fe640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x5559753584d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fabc000fc90 tx=0x7fabc000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713c40471050a5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabab7fe640 1 -- 172.21.15.83:0/2575775520 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0004c80 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabab7fe640 1 -- 172.21.15.83:0/2575775520 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fabc0004f60 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.415+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc000a840 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabab7fe640 1 -- 172.21.15.83:0/2575775520 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fabc0044050 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 10 client.15210 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5559753bd5d0 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabab7fe640 1 -- 172.21.15.83:0/2575775520 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fabc000a840 con 0x5559753379d0 2024-09-19T09:02:48.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabab7fe640 1 -- 172.21.15.83:0/2575775520 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fabc0036500 con 0x5559753379d0 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 10 client.15210 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 10 client.15210 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 20 client.15210 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753c1940 0x5559753c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 4 client.15210 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 --> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] -- command(tid 0: {"prefix": "status"}) -- 0x5559752a5b10 con 0x5559753c1940 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.416+0000 7fabcbfff640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753c1940 0x5559753c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabab7fe640 10 client.15210 ms_handle_connect on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabcbfff640 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753c1940 0x5559753c0650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=448969a2a0c7fd5f server_cookie=330baebf3bcd3984 in_seq=0 out_seq=0 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabab7fe640 1 -- 172.21.15.83:0/2575775520 <== mds.3 v2:172.21.15.184:6836/236760278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5559752a5b10 con 0x5559753c1940 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabab7fe640 10 client.15210 handle_command_reply: tid=0 2024-09-19T09:02:48.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 client.15210 shutdown 2024-09-19T09:02:48.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 msgr2=0x5559753584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x5559753584d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fabc000fc90 tx=0x7fabc000a360 comp rx=0 tx=0).stop 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 shutdown_connections 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:6836/236760278,v1:172.21.15.184:6837/236760278] conn(0x5559753c1940 0x5559753c0650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555975342bb0 0x5559753bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5559753382f0 0x555975358a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 --2- 172.21.15.83:0/2575775520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559753379d0 0x5559753584d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 >> 172.21.15.83:0/2575775520 conn(0x555975333f60 msgr2=0x5559753327e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabab7fe640 0 client.15210 ms_handle_reset on v2:172.21.15.184:6836/236760278 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 shutdown_connections 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 1 -- 172.21.15.83:0/2575775520 wait complete. 2024-09-19T09:02:48.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.417+0000 7fabd4c16740 20 client.15210 trim_cache size 0 max 16384 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 3, 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24430, 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 93.394455833999999, 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 155.05728952800001 2024-09-19T09:02:48.434 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:48.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fabb40a3240 msgr2=0x7fabb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fabb40a3240 0x7fabb40a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fabc4098760 tx=0x7fabc40917e0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 msgr2=0x7fabcc19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 0x7fabcc19cc00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fabc400cce0 tx=0x7fabc400a620 comp rx=0 tx=0).stop 2024-09-19T09:02:48.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 shutdown_connections 2024-09-19T09:02:48.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fabb40a3240 0x7fabb40a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabcc10c180 0x7fabcc19cc00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabcc103700 0x7fabcc198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 --2- 172.21.15.83:0/3068287179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabcc102de0 0x7fabcc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 >> 172.21.15.83:0/3068287179 conn(0x7fabcc0fc7a0 msgr2=0x7fabcc0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 shutdown_connections 2024-09-19T09:02:48.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:48.418+0000 7fabd283d640 1 -- 172.21.15.83:0/3068287179 wait complete. 2024-09-19T09:02:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:47 smithi122 ceph-mon[34247]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:02:49.164 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:02:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:49.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 -- 172.21.15.83:0/1667189699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 msgr2=0x7fe53010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 --2- 172.21.15.83:0/1667189699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53010da40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe528009ca0 tx=0x7fe52802a950 comp rx=0 tx=0).stop 2024-09-19T09:02:49.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 -- 172.21.15.83:0/1667189699 shutdown_connections 2024-09-19T09:02:49.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 --2- 172.21.15.83:0/1667189699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53010da40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 --2- 172.21.15.83:0/1667189699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 0x7fe5301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 --2- 172.21.15.83:0/1667189699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 0x7fe530101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 -- 172.21.15.83:0/1667189699 >> 172.21.15.83:0/1667189699 conn(0x7fe5300fc7d0 msgr2=0x7fe5300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 -- 172.21.15.83:0/1667189699 shutdown_connections 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.893+0000 7fe535a85640 1 -- 172.21.15.83:0/1667189699 wait complete. 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 Processor -- start 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 -- start start 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 0x7fe5301983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 0x7fe530198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe530110e30 con 0x7fe530102ef0 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe530110cb0 con 0x7fe530102570 2024-09-19T09:02:49.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe535a85640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe530110fb0 con 0x7fe530100e20 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe52ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe52ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57878/0 (socket says 172.21.15.83:57878) 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe52ffff640 1 -- 172.21.15.83:0/728116433 learned_addr learned my addr 172.21.15.83:0/728116433 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 0x7fe5301983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.894+0000 7fe527fff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 0x7fe530198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52ffff640 1 -- 172.21.15.83:0/728116433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 msgr2=0x7fe5301983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52ffff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 0x7fe5301983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52ffff640 1 -- 172.21.15.83:0/728116433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 msgr2=0x7fe530198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52ffff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 0x7fe530198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52ffff640 1 -- 172.21.15.83:0/728116433 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53019d370 con 0x7fe530102ef0 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 0x7fe5301983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:49.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe527fff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 0x7fe530198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52ffff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53019cc90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe52802ae70 tx=0x7fe52802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52d7fa640 1 -- 172.21.15.83:0/728116433 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528034040 con 0x7fe530102ef0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52d7fa640 1 -- 172.21.15.83:0/728116433 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5280308f0 con 0x7fe530102ef0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe52d7fa640 1 -- 172.21.15.83:0/728116433 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528004780 con 0x7fe530102ef0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53019d600 con 0x7fe530102ef0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.895+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5301a4f40 con 0x7fe530102ef0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.897+0000 7fe52d7fa640 1 -- 172.21.15.83:0/728116433 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe528037020 con 0x7fe530102ef0 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 Processor -- start 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 -- start start 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c92f0 0x5644b88d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 0x5644b88d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b882f090 con 0x5644b88d3bb0 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644b87d6a70 con 0x5644b88c89d0 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe537e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5644b882b050 con 0x5644b88c92f0 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 0x5644b88d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 0x5644b88d5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57892/0 (socket says 172.21.15.83:57892) 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 -- 172.21.15.83:0/3631384099 learned_addr learned my addr 172.21.15.83:0/3631384099 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c92f0 0x5644b88d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe52d7fa640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe51c0a3340 0x7fe51c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 -- 172.21.15.83:0/3631384099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c92f0 msgr2=0x5644b88d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe52ffff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe51c0a3340 0x7fe51c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c92f0 0x5644b88d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 -- 172.21.15.83:0/3631384099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 msgr2=0x5644b88c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.898+0000 7fe527fff640 1 -- 172.21.15.83:0/3631384099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644b87e3130 con 0x5644b88d3bb0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe52d7fa640 1 -- 172.21.15.83:0/728116433 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe5280f0de0 con 0x7fe530102ef0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe527fff640 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 0x5644b88d5fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe51800dc10 tx=0x7fe51800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f835a76134494cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe525ffb640 1 -- 172.21.15.83:0/3631384099 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518011640 con 0x5644b88d3bb0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe525ffb640 1 -- 172.21.15.83:0/3631384099 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe518011c90 con 0x5644b88d3bb0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe52ffff640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe51c0a3340 0x7fe51c0a5800 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5280bcd40 tx=0x7fe52808fec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe525ffb640 1 -- 172.21.15.83:0/3631384099 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518019cc0 con 0x5644b88d3bb0 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe537e5e740 1 -- 172.21.15.83:0/3631384099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 msgr2=0x5644b88d5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe537e5e740 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 0x5644b88d5fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe51800dc10 tx=0x7fe51800f730 comp rx=0 tx=0).stop 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe537e5e740 1 -- 172.21.15.83:0/3631384099 shutdown_connections 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.899+0000 7fe537e5e740 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88d3bb0 0x5644b88d5fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c92f0 0x5644b88d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 --2- 172.21.15.83:0/3631384099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- 172.21.15.83:0/3631384099 >> 172.21.15.83:0/3631384099 conn(0x5644b88c4f60 msgr2=0x5644b88c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- 172.21.15.83:0/3631384099 shutdown_connections 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- 172.21.15.83:0/3631384099 wait complete. 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- start start 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 Processor -- start 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b88d6780 con 0x5644b88c92f0 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644b87e9f20 con 0x5644b88d3bb0 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5644b88d6900 con 0x5644b88c89d0 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe537e5e740 10 client.0 _ll_register_callbacks cb 0x5644b87b3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.900+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57904/0 (socket says 172.21.15.83:57904) 2024-09-19T09:02:49.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 -- 172.21.15.83:0/153655840 learned_addr learned my addr 172.21.15.83:0/153655840 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe527fff640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe527fff640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 -- 172.21.15.83:0/153655840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 msgr2=0x5644b88d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 -- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 msgr2=0x5644b88d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 -- 172.21.15.83:0/153655840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644b85a02b0 con 0x5644b88c92f0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88d0810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe520009fc0 tx=0x7fe520011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dc9336e918bb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe50effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe50effd640 1 -- 172.21.15.83:0/153655840 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520012920 con 0x5644b88c92f0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe50effd640 1 -- 172.21.15.83:0/153655840 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe520012ac0 con 0x5644b88c92f0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe518011c90 con 0x5644b88c92f0 2024-09-19T09:02:49.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe50effd640 1 -- 172.21.15.83:0/153655840 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe520025050 con 0x5644b88c92f0 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe537e5e740 10 client.15222 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.901+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5644b88e21b0 con 0x5644b88c92f0 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe50effd640 1 -- 172.21.15.83:0/153655840 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe518011c90 con 0x5644b88c92f0 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe50effd640 1 -- 172.21.15.83:0/153655840 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe52000f040 con 0x5644b88c92f0 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe537e5e740 10 client.15222 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe537e5e740 10 client.15222 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe537e5e740 20 client.15222 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe537e5e740 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b88e4820 0x5644b88e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe537e5e740 4 client.15222 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 --> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644b883c600 con 0x5644b88e4820 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe527fff640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b88e4820 0x5644b88e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe50effd640 10 client.15222 ms_handle_connect on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.902+0000 7fe527fff640 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b88e4820 0x5644b88e5c90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b06b4868651329dc server_cookie=e557cebe3a33093 in_seq=0 out_seq=0 2024-09-19T09:02:49.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe50effd640 1 -- 172.21.15.83:0/153655840 <== mds.2 v2:172.21.15.122:6836/3109792741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644b883c600 con 0x5644b88e4820 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe50effd640 10 client.15222 handle_command_reply: tid=0 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 client.15222 shutdown 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 msgr2=0x5644b88d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88d0810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe520009fc0 tx=0x7fe520011870 comp rx=0 tx=0).stop 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 shutdown_connections 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b88e4820 0x5644b88e5c90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88d0810 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe50effd640 0 client.15222 ms_handle_reset on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:49.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 --2- 172.21.15.83:0/153655840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 >> 172.21.15.83:0/153655840 conn(0x5644b88c4f60 msgr2=0x5644b88cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 shutdown_connections 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.903+0000 7fe537e5e740 1 -- 172.21.15.83:0/153655840 wait complete. 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.904+0000 7fe537e5e740 20 client.15222 trim_cache size 0 max 16384 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 Processor -- start 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 -- start start 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b88e3fd0 con 0x5644b88c92f0 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644b88e46a0 con 0x5644b88d3bb0 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe537e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5644b88e4d70 con 0x5644b88c89d0 2024-09-19T09:02:49.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57918/0 (socket says 172.21.15.83:57918) 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 -- 172.21.15.83:0/2006383778 learned_addr learned my addr 172.21.15.83:0/2006383778 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 -- 172.21.15.83:0/2006383778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 msgr2=0x5644b88cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 -- 172.21.15.83:0/2006383778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 msgr2=0x5644b88cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.921+0000 7fe52f7fe640 1 -- 172.21.15.83:0/2006383778 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644b88c8800 con 0x5644b88c92f0 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88cb5c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe520019440 tx=0x7fe520005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96fe83a5e32e268 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe5257fa640 1 -- 172.21.15.83:0/2006383778 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520000e60 con 0x5644b88c92f0 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe5257fa640 1 -- 172.21.15.83:0/2006383778 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe52002d030 con 0x5644b88c92f0 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe5257fa640 1 -- 172.21.15.83:0/2006383778 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520012d90 con 0x5644b88c92f0 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 -- 172.21.15.83:0/2006383778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 msgr2=0x5644b88cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88cb5c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe520019440 tx=0x7fe520005870 comp rx=0 tx=0).stop 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 -- 172.21.15.83:0/2006383778 shutdown_connections 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88d3bb0 0x5644b88cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88cb5c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 --2- 172.21.15.83:0/2006383778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88c89d0 0x5644b88cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 -- 172.21.15.83:0/2006383778 >> 172.21.15.83:0/2006383778 conn(0x5644b88c4f60 msgr2=0x5644b88cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 -- 172.21.15.83:0/2006383778 shutdown_connections 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.922+0000 7fe537e5e740 1 -- 172.21.15.83:0/2006383778 wait complete. 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 -- start start 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 Processor -- start 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88d3bb0 0x5644b894cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b88e5b10 con 0x5644b88c92f0 2024-09-19T09:02:49.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644b88e5440 con 0x5644b88c89d0 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5644b88e61e0 con 0x5644b88d3bb0 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe537e5e740 10 client.0 _ll_register_callbacks cb 0x7fe5200097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57932/0 (socket says 172.21.15.83:57932) 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe52f7fe640 1 -- 172.21.15.83:0/1098153077 learned_addr learned my addr 172.21.15.83:0/1098153077 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.923+0000 7fe527fff640 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe52f7fe640 1 -- 172.21.15.83:0/1098153077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88d3bb0 msgr2=0x5644b894cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88d3bb0 0x5644b894cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe52f7fe640 1 -- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 msgr2=0x5644b88e76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88e76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe52f7fe640 1 -- 172.21.15.83:0/1098153077 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644b894d4e0 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe52f7fe640 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88e7be0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe520009ad0 tx=0x7fe520009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c83536091c69d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe50effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe50effd640 1 -- 172.21.15.83:0/1098153077 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520012d10 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe50effd640 1 -- 172.21.15.83:0/1098153077 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe520005040 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe52002d030 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe50effd640 1 -- 172.21.15.83:0/1098153077 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe520044050 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe537e5e740 10 client.15228 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5644b894e7e0 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe50effd640 1 -- 172.21.15.83:0/1098153077 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe52002d030 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.924+0000 7fe50effd640 1 -- 172.21.15.83:0/1098153077 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe520004c70 con 0x5644b88c92f0 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe537e5e740 10 client.15228 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe537e5e740 10 client.15228 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe537e5e740 20 client.15228 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:49.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe537e5e740 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b8952fc0 0x5644b8951cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe537e5e740 4 client.15228 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 --> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] -- command(tid 0: {"prefix": "status"}) -- 0x5644b8836b10 con 0x5644b8952fc0 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe527fff640 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b8952fc0 0x5644b8951cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe50effd640 10 client.15228 ms_handle_connect on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.925+0000 7fe527fff640 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b8952fc0 0x5644b8951cd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a7667e4bd659a96 server_cookie=5e49f9ba9c2e485f in_seq=0 out_seq=0 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe50effd640 1 -- 172.21.15.83:0/1098153077 <== mds.2 v2:172.21.15.122:6836/3109792741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5644b8836b10 con 0x5644b8952fc0 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe50effd640 10 client.15228 handle_command_reply: tid=0 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 client.15228 shutdown 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 msgr2=0x5644b88e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88e7be0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe520009ad0 tx=0x7fe520009bc0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 shutdown_connections 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:6836/3109792741,v1:172.21.15.122:6837/3109792741] conn(0x5644b8952fc0 0x5644b8951cd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5644b88d3bb0 0x5644b894cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b88c92f0 0x5644b88e7be0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 --2- 172.21.15.83:0/1098153077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b88c89d0 0x5644b88e76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 >> 172.21.15.83:0/1098153077 conn(0x5644b88c4f60 msgr2=0x5644b88cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe50effd640 0 client.15228 ms_handle_reset on v2:172.21.15.122:6836/3109792741 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 shutdown_connections 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 1 -- 172.21.15.83:0/1098153077 wait complete. 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe537e5e740 20 client.15228 trim_cache size 0 max 16384 2024-09-19T09:02:49.943 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 2, 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24443, 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 95.907682668000007, 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 153.84956444100001 2024-09-19T09:02:49.944 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:49.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe51c0a3340 msgr2=0x7fe51c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe535a85640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe51c0a3340 0x7fe51c0a5800 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5280bcd40 tx=0x7fe52808fec0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 msgr2=0x7fe53019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.926+0000 7fe535a85640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53019cc90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe52802ae70 tx=0x7fe52802f5d0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 shutdown_connections 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fe51c0a3340 0x7fe51c0a5800 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe530102ef0 0x7fe53019cc90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe530102570 0x7fe530198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 --2- 172.21.15.83:0/728116433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe530100e20 0x7fe5301983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 >> 172.21.15.83:0/728116433 conn(0x7fe5300fc7d0 msgr2=0x7fe530069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 shutdown_connections 2024-09-19T09:02:49.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:49.927+0000 7fe535a85640 1 -- 172.21.15.83:0/728116433 wait complete. 2024-09-19T09:02:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:50 smithi083 ceph-mon[30926]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:02:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:50 smithi184 ceph-mon[35007]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:02:50.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:50 smithi122 ceph-mon[34247]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:02:50.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:02:50.984 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 -- 172.21.15.83:0/3896602913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 msgr2=0x7fa46010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 --2- 172.21.15.83:0/3896602913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010d950 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa458009cd0 tx=0x7fa45802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 -- 172.21.15.83:0/3896602913 shutdown_connections 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 --2- 172.21.15.83:0/3896602913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010d950 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 --2- 172.21.15.83:0/3896602913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa460100a80 0x7fa460100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 --2- 172.21.15.83:0/3896602913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460106a80 0x7fa460106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 -- 172.21.15.83:0/3896602913 >> 172.21.15.83:0/3896602913 conn(0x7fa4600fc7a0 msgr2=0x7fa4600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 -- 172.21.15.83:0/3896602913 shutdown_connections 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.423+0000 7fa467d20640 1 -- 172.21.15.83:0/3896602913 wait complete. 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 Processor -- start 2024-09-19T09:02:51.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 -- start start 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460100a80 0x7fa46010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa460106a80 0x7fa46010ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa460111eb0 con 0x7fa460101420 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa460111d30 con 0x7fa460100a80 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa467d20640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa460112030 con 0x7fa460106a80 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56842/0 (socket says 172.21.15.83:56842) 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 -- 172.21.15.83:0/2597145680 learned_addr learned my addr 172.21.15.83:0/2597145680 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4662bd640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa460106a80 0x7fa46010ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa465abc640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460100a80 0x7fa46010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 -- 172.21.15.83:0/2597145680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa460106a80 msgr2=0x7fa46010ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa460106a80 0x7fa46010ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 -- 172.21.15.83:0/2597145680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460100a80 msgr2=0x7fa46010e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460100a80 0x7fa46010e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 -- 172.21.15.83:0/2597145680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4601a6810 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa465abc640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460100a80 0x7fa46010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.424+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010e920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00c920 tx=0x7fa45c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.425+0000 7fa452ffd640 1 -- 172.21.15.83:0/2597145680 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c007c70 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.425+0000 7fa452ffd640 1 -- 172.21.15.83:0/2597145680 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa45c007e10 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.425+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4601a6b00 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.425+0000 7fa452ffd640 1 -- 172.21.15.83:0/2597145680 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c018820 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.425+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a7090 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.427+0000 7fa452ffd640 1 -- 172.21.15.83:0/2597145680 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa45c0189c0 con 0x7fa460101420 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.427+0000 7fa46a0f9740 1 Processor -- start 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 -- start start 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa452ffd640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa44c0a32c0 0x7fa44c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b78bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b796670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b798fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55646b6f2090 con 0x55646b78b9d0 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55646b699a70 con 0x55646b796bb0 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55646b6ee050 con 0x55646b78c2f0 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa452ffd640 1 -- 172.21.15.83:0/2597145680 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa45c0cfe50 con 0x7fa460101420 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa4662bd640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa44c0a32c0 0x7fa44c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b78bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b78bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56844/0 (socket says 172.21.15.83:56844) 2024-09-19T09:02:51.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 -- 172.21.15.83:0/456452134 learned_addr learned my addr 172.21.15.83:0/456452134 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa4652bb640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b796670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa4662bd640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b798fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 -- 172.21.15.83:0/456452134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 msgr2=0x55646b796670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b796670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 -- 172.21.15.83:0/456452134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 msgr2=0x55646b798fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b798fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa465abc640 1 -- 172.21.15.83:0/456452134 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646b6a6130 con 0x55646b78b9d0 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa4662bd640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b798fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.428+0000 7fa4652bb640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b796670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa4662bd640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa44c0a32c0 0x7fa44c0a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa458009a60 tx=0x7fa458031610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa465abc640 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b78bdb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa45400aa10 tx=0x7fa45400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d084598c0017ecd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa44bfff640 1 -- 172.21.15.83:0/456452134 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454015070 con 0x55646b78b9d0 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa44bfff640 1 -- 172.21.15.83:0/456452134 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa45400cc60 con 0x55646b78b9d0 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa44bfff640 1 -- 172.21.15.83:0/456452134 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540185c0 con 0x55646b78b9d0 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa46a0f9740 1 -- 172.21.15.83:0/456452134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 msgr2=0x55646b78bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.429+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b78bdb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa45400aa10 tx=0x7fa45400aed0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- 172.21.15.83:0/456452134 shutdown_connections 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b798fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b796670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/456452134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b78bdb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- 172.21.15.83:0/456452134 >> 172.21.15.83:0/456452134 conn(0x55646b787f60 msgr2=0x55646b788340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- 172.21.15.83:0/456452134 shutdown_connections 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- 172.21.15.83:0/456452134 wait complete. 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- start start 2024-09-19T09:02:51.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 Processor -- start 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b796260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7935b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b793af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55646b799780 con 0x55646b78b9d0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55646b6acf20 con 0x55646b796bb0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.430+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55646b799900 con 0x55646b78c2f0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa46a0f9740 10 client.0 _ll_register_callbacks cb 0x55646b676030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b796260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b796260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56854/0 (socket says 172.21.15.83:56854) 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 -- 172.21.15.83:0/2575275225 learned_addr learned my addr 172.21.15.83:0/2575275225 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4662bd640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b793af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7935b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 -- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 msgr2=0x55646b7935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7935b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 -- 172.21.15.83:0/2575275225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 msgr2=0x55646b793af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b793af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 -- 172.21.15.83:0/2575275225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646b4632b0 con 0x55646b78b9d0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4662bd640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b793af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa465abc640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b796260 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa454011c30 tx=0x7fa454011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb9917797163eec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4497fa640 1 -- 172.21.15.83:0/2575275225 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454020070 con 0x55646b78b9d0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45400cc60 con 0x55646b78b9d0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4497fa640 1 -- 172.21.15.83:0/2575275225 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa45401a660 con 0x55646b78b9d0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4497fa640 1 -- 172.21.15.83:0/2575275225 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa454015040 con 0x55646b78b9d0 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa46a0f9740 10 client.15240 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55646b7a4e40 con 0x55646b78b9d0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.431+0000 7fa4497fa640 1 -- 172.21.15.83:0/2575275225 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa45400cc60 con 0x55646b78b9d0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa4497fa640 1 -- 172.21.15.83:0/2575275225 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa454024620 con 0x55646b78b9d0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa46a0f9740 10 client.15240 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa46a0f9740 10 client.15240 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa46a0f9740 20 client.15240 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b7a70e0 0x55646b7a8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa46a0f9740 4 client.15240 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 --> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55646b6ff600 con 0x55646b7a70e0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b7a70e0 0x55646b7a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa4497fa640 10 client.15240 ms_handle_connect on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.432+0000 7fa4652bb640 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b7a70e0 0x55646b7a8550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1caea911ab3baa8 server_cookie=12957ed1df1c736b in_seq=0 out_seq=0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa4497fa640 1 -- 172.21.15.83:0/2575275225 <== mds.1 v2:172.21.15.184:6838/1323973245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55646b6ff600 con 0x55646b7a70e0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa4497fa640 10 client.15240 handle_command_reply: tid=0 2024-09-19T09:02:51.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 client.15240 shutdown 2024-09-19T09:02:51.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 msgr2=0x55646b796260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b796260 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa454011c30 tx=0x7fa454011c60 comp rx=0 tx=0).stop 2024-09-19T09:02:51.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 shutdown_connections 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b7a70e0 0x55646b7a8550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b796bb0 0x55646b793af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/2575275225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78b9d0 0x55646b796260 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.433+0000 7fa4497fa640 0 client.15240 ms_handle_reset on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.434+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 >> 172.21.15.83:0/2575275225 conn(0x55646b787f60 msgr2=0x55646b78dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.434+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 shutdown_connections 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.434+0000 7fa46a0f9740 1 -- 172.21.15.83:0/2575275225 wait complete. 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.434+0000 7fa46a0f9740 20 client.15240 trim_cache size 0 max 16384 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 Processor -- start 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 -- start start 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 0x55646b7b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b796bb0 0x55646b7b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55646b7a6890 con 0x55646b78c2f0 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55646b7a6f60 con 0x55646b78b9d0 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55646b7a7630 con 0x55646b796bb0 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa4652bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 0x55646b7b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa4652bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 0x55646b7b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56856/0 (socket says 172.21.15.83:56856) 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa4652bb640 1 -- 172.21.15.83:0/1935162304 learned_addr learned my addr 172.21.15.83:0/1935162304 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa4662bd640 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b796bb0 0x55646b7b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa465abc640 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa4652bb640 1 -- 172.21.15.83:0/1935162304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b796bb0 msgr2=0x55646b7b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.451+0000 7fa4652bb640 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b796bb0 0x55646b7b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa4652bb640 1 -- 172.21.15.83:0/1935162304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 msgr2=0x55646b7a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa4652bb640 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa4652bb640 1 -- 172.21.15.83:0/1935162304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646b78f1b0 con 0x55646b78c2f0 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa465abc640 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa4652bb640 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 0x55646b7b0830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa45c09c040 tx=0x7fa45c0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5942e9540abed070 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa44b7fe640 1 -- 172.21.15.83:0/1935162304 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0a0460 con 0x55646b78c2f0 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa44b7fe640 1 -- 172.21.15.83:0/1935162304 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa45c0a4d20 con 0x55646b78c2f0 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa44b7fe640 1 -- 172.21.15.83:0/1935162304 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0cd610 con 0x55646b78c2f0 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1935162304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 msgr2=0x55646b7b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 0x55646b7b0830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa45c09c040 tx=0x7fa45c0bc040 comp rx=0 tx=0).stop 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1935162304 shutdown_connections 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b796bb0 0x55646b7b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b78c2f0 0x55646b7b0830 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1935162304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.452+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1935162304 >> 172.21.15.83:0/1935162304 conn(0x55646b787f60 msgr2=0x55646b794150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1935162304 shutdown_connections 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1935162304 wait complete. 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 -- start start 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 Processor -- start 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 0x55646b7a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55646b7a83d0 con 0x55646b796bb0 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55646b7a7d00 con 0x55646b78b9d0 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55646b7a8aa0 con 0x55646b78c2f0 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa46a0f9740 10 client.0 _ll_register_callbacks cb 0x7fa45400a860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa4662bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 0x55646b7a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa4662bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 0x55646b7a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56872/0 (socket says 172.21.15.83:56872) 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.453+0000 7fa4662bd640 1 -- 172.21.15.83:0/1888761271 learned_addr learned my addr 172.21.15.83:0/1888761271 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:51.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa465abc640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4652bb640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4662bd640 1 -- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 msgr2=0x55646b7b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4662bd640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4662bd640 1 -- 172.21.15.83:0/1888761271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 msgr2=0x55646b7b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4662bd640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4662bd640 1 -- 172.21.15.83:0/1888761271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646b7aa780 con 0x55646b796bb0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa465abc640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4652bb640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4662bd640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 0x55646b7a9f80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa458009cd0 tx=0x7fa45803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9730fbadc4f530ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4497fa640 1 -- 172.21.15.83:0/1888761271 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45804d070 con 0x55646b796bb0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45c0a4d20 con 0x55646b796bb0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4497fa640 1 -- 172.21.15.83:0/1888761271 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa4580307a0 con 0x55646b796bb0 2024-09-19T09:02:51.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa4497fa640 1 -- 172.21.15.83:0/1888761271 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa45805b050 con 0x55646b796bb0 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa46a0f9740 10 client.15246 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.454+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55646b7af260 con 0x55646b796bb0 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa4497fa640 1 -- 172.21.15.83:0/1888761271 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa45c0a4d20 con 0x55646b796bb0 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa4497fa640 1 -- 172.21.15.83:0/1888761271 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa458030070 con 0x55646b796bb0 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa46a0f9740 10 client.15246 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa46a0f9740 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa46a0f9740 20 client.15246 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b816050 0x55646b814d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa46a0f9740 4 client.15246 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 --> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] -- command(tid 0: {"prefix": "status"}) -- 0x55646b6f9b10 con 0x55646b816050 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa465abc640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b816050 0x55646b814d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa465abc640 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b816050 0x55646b814d60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e75d245a0a8a4f79 server_cookie=1872385f83dd84d5 in_seq=0 out_seq=0 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.455+0000 7fa4497fa640 10 client.15246 ms_handle_connect on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa4497fa640 1 -- 172.21.15.83:0/1888761271 <== mds.1 v2:172.21.15.184:6838/1323973245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55646b6f9b10 con 0x55646b816050 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa4497fa640 10 client.15246 handle_command_reply: tid=0 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 client.15246 shutdown 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 msgr2=0x55646b7a9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 0x55646b7a9f80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa458009cd0 tx=0x7fa45803f070 comp rx=0 tx=0).stop 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 shutdown_connections 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:6838/1323973245,v1:172.21.15.184:6839/1323973245] conn(0x55646b816050 0x55646b814d60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646b796bb0 0x55646b7a9f80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa4497fa640 0 client.15246 ms_handle_reset on v2:172.21.15.184:6838/1323973245 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55646b78c2f0 0x55646b7b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 --2- 172.21.15.83:0/1888761271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55646b78b9d0 0x55646b7b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 >> 172.21.15.83:0/1888761271 conn(0x55646b787f60 msgr2=0x55646b78d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 shutdown_connections 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 1 -- 172.21.15.83:0/1888761271 wait complete. 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.456+0000 7fa46a0f9740 20 client.15246 trim_cache size 0 max 16384 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 1, 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24445, 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:51.478 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 98.445606678000004, 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 152.84117192400001 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:51.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa44c0a32c0 msgr2=0x7fa44c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa44c0a32c0 0x7fa44c0a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa458009a60 tx=0x7fa458031610 comp rx=0 tx=0).stop 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 msgr2=0x7fa46010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010e920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00c920 tx=0x7fa45c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 shutdown_connections 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7fa44c0a32c0 0x7fa44c0a5780 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa460106a80 0x7fa46010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa460101420 0x7fa46010e920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 --2- 172.21.15.83:0/2597145680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa460100a80 0x7fa46010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 >> 172.21.15.83:0/2597145680 conn(0x7fa4600fc7a0 msgr2=0x7fa4600fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 shutdown_connections 2024-09-19T09:02:51.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:51.457+0000 7fa467d20640 1 -- 172.21.15.83:0/2597145680 wait complete. 2024-09-19T09:02:52.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:02:52.272 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:52 smithi083 ceph-mon[30926]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T09:02:52.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:52 smithi184 ceph-mon[35007]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T09:02:52.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:52 smithi122 ceph-mon[34247]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T09:02:52.494 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3930316747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8106a80 msgr2=0x7f6cb8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3930316747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8106a80 0x7f6cb8106e60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009930 tx=0x7f6ca802a420 comp rx=0 tx=0).stop 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3930316747 shutdown_connections 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3930316747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb8101420 0x7f6cb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3930316747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cb8100a80 0x7f6cb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3930316747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8106a80 0x7f6cb8106e60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3930316747 >> 172.21.15.83:0/3930316747 conn(0x7f6cb80fc7a0 msgr2=0x7f6cb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3930316747 shutdown_connections 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.933+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3930316747 wait complete. 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 Processor -- start 2024-09-19T09:02:52.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 -- start start 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb8100a80 0x7f6cb810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 0x7f6cb810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cb8106a80 0x7f6cb810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8111e50 con 0x7f6cb8101420 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8111cd0 con 0x7f6cb8106a80 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbe92c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8111fd0 con 0x7f6cb8100a80 2024-09-19T09:02:52.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 0x7f6cb810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 0x7f6cb810e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56878/0 (socket says 172.21.15.83:56878) 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cb77fe640 1 -- 172.21.15.83:0/3985025099 learned_addr learned my addr 172.21.15.83:0/3985025099 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.934+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cb8106a80 0x7f6cb810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb8100a80 0x7f6cb810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb77fe640 1 -- 172.21.15.83:0/3985025099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb8100a80 msgr2=0x7f6cb810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb8100a80 0x7f6cb810e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb77fe640 1 -- 172.21.15.83:0/3985025099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cb8106a80 msgr2=0x7f6cb810ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cb8106a80 0x7f6cb810ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb77fe640 1 -- 172.21.15.83:0/3985025099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb81a6870 con 0x7f6cb8101420 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 0x7f6cb810e920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00d950 tx=0x7f6cac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb57fa640 1 -- 172.21.15.83:0/3985025099 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac017070 con 0x7f6cb8101420 2024-09-19T09:02:52.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb57fa640 1 -- 172.21.15.83:0/3985025099 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cac009c30 con 0x7f6cb8101420 2024-09-19T09:02:52.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb81a6b60 con 0x7f6cb8101420 2024-09-19T09:02:52.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cb57fa640 1 -- 172.21.15.83:0/3985025099 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00f620 con 0x7f6cb8101420 2024-09-19T09:02:52.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.935+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb81a70f0 con 0x7f6cb8101420 2024-09-19T09:02:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cb57fa640 1 -- 172.21.15.83:0/3985025099 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6cac0109a0 con 0x7f6cb8101420 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 Processor -- start 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 -- start start 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5ead9d0 0x5584a5eaddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ebafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5584a5e14090 con 0x5584a5eb8bb0 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5584a5dbba70 con 0x5584a5ead9d0 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.938+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5584a5e10050 con 0x5584a5eae2f0 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ebafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ebafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56880/0 (socket says 172.21.15.83:56880) 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 -- 172.21.15.83:0/1077717158 learned_addr learned my addr 172.21.15.83:0/1077717158 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5ead9d0 0x5584a5eaddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb57fa640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ca00a32c0 0x7f6ca00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ca00a32c0 0x7f6ca00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb57fa640 1 -- 172.21.15.83:0/3985025099 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6cac0cf8e0 con 0x7f6cb8101420 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 -- 172.21.15.83:0/1077717158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 msgr2=0x5584a5eb8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 -- 172.21.15.83:0/1077717158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5ead9d0 msgr2=0x5584a5eaddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5ead9d0 0x5584a5eaddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 -- 172.21.15.83:0/1077717158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a5dc8130 con 0x5584a5eb8bb0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ebafa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0ccfc0 tx=0x7f6cac00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeadde03f70835c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ca00a32c0 0x7f6ca00a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009fd0 tx=0x7f6cb0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6c9e7fc640 1 -- 172.21.15.83:0/1077717158 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac020070 con 0x5584a5eb8bb0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.939+0000 7f6c9e7fc640 1 -- 172.21.15.83:0/1077717158 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cac009de0 con 0x5584a5eb8bb0 2024-09-19T09:02:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6c9e7fc640 1 -- 172.21.15.83:0/1077717158 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0d1e60 con 0x5584a5eb8bb0 2024-09-19T09:02:52.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 -- 172.21.15.83:0/1077717158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 msgr2=0x5584a5ebafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ebafa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0ccfc0 tx=0x7f6cac00bf60 comp rx=0 tx=0).stop 2024-09-19T09:02:52.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 -- 172.21.15.83:0/1077717158 shutdown_connections 2024-09-19T09:02:52.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ebafa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/1077717158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5ead9d0 0x5584a5eaddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 -- 172.21.15.83:0/1077717158 >> 172.21.15.83:0/1077717158 conn(0x5584a5ea9f60 msgr2=0x5584a5eaa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 -- 172.21.15.83:0/1077717158 shutdown_connections 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.940+0000 7f6cc0d05740 1 -- 172.21.15.83:0/1077717158 wait complete. 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 -- start start 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 Processor -- start 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 0x5584a5eb84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ebb720 con 0x5584a5ead9d0 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5584a5dcef20 con 0x5584a5eb8bb0 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ebb8a0 con 0x5584a5eae2f0 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cc0d05740 10 client.0 _ll_register_callbacks cb 0x5584a5d98030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:52.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 0x5584a5eb84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 0x5584a5eb84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56892/0 (socket says 172.21.15.83:56892) 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cb7fff640 1 -- 172.21.15.83:0/3923948742 learned_addr learned my addr 172.21.15.83:0/3923948742 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.941+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cb7fff640 1 -- 172.21.15.83:0/3923948742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 msgr2=0x5584a5eb5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cb7fff640 1 -- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 msgr2=0x5584a5eb5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cb7fff640 1 -- 172.21.15.83:0/3923948742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a5b852b0 con 0x5584a5ead9d0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 0x5584a5eb84c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000c00 tx=0x7f6ca8032ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb774b019be13699 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6c977fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6c977fe640 1 -- 172.21.15.83:0/3923948742 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8040070 con 0x5584a5ead9d0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6c977fe640 1 -- 172.21.15.83:0/3923948742 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6ca8004040 con 0x5584a5ead9d0 2024-09-19T09:02:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cac009de0 con 0x5584a5ead9d0 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6c977fe640 1 -- 172.21.15.83:0/3923948742 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ca8035040 con 0x5584a5ead9d0 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cc0d05740 10 client.15258 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5584a5ec7120 con 0x5584a5ead9d0 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6c977fe640 1 -- 172.21.15.83:0/3923948742 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cac009de0 con 0x5584a5ead9d0 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.942+0000 7f6c977fe640 1 -- 172.21.15.83:0/3923948742 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6ca80047e0 con 0x5584a5ead9d0 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cc0d05740 10 client.15258 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cc0d05740 10 client.15258 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cc0d05740 20 client.15258 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5ec9750 0x5584a5ecabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cc0d05740 4 client.15258 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 --> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584a5e21600 con 0x5584a5ec9750 2024-09-19T09:02:52.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5ec9750 0x5584a5ecabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5ec9750 0x5584a5ecabc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5db760556d4efff1 server_cookie=ae7a488d827c2190 in_seq=0 out_seq=0 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.943+0000 7f6c977fe640 10 client.15258 ms_handle_connect on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6c977fe640 1 -- 172.21.15.83:0/3923948742 <== mds.0 v2:172.21.15.122:6838/1686011933 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584a5e21600 con 0x5584a5ec9750 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6c977fe640 10 client.15258 handle_command_reply: tid=0 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 client.15258 shutdown 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 msgr2=0x5584a5eb84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 0x5584a5eb84c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000c00 tx=0x7f6ca8032ee0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 shutdown_connections 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5ec9750 0x5584a5ecabc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5eae2f0 0x5584a5eb5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3923948742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5ead9d0 0x5584a5eb84c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6c977fe640 0 client.15258 ms_handle_reset on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:52.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 >> 172.21.15.83:0/3923948742 conn(0x5584a5ea9f60 msgr2=0x5584a5eafc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 shutdown_connections 2024-09-19T09:02:52.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3923948742 wait complete. 2024-09-19T09:02:52.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.944+0000 7f6cc0d05740 20 client.15258 trim_cache size 0 max 16384 2024-09-19T09:02:52.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 Processor -- start 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 -- start start 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 0x5584a5eb4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ec8f00 con 0x5584a5eae2f0 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ec95d0 con 0x5584a5eb8bb0 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ec9ca0 con 0x5584a5ead9d0 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 0x5584a5eb4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 0x5584a5eb4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56898/0 (socket says 172.21.15.83:56898) 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 -- 172.21.15.83:0/2023087179 learned_addr learned my addr 172.21.15.83:0/2023087179 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 -- 172.21.15.83:0/2023087179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 msgr2=0x5584a5ecabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 -- 172.21.15.83:0/2023087179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 msgr2=0x5584a5eb6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 -- 172.21.15.83:0/2023087179 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a5eb80e0 con 0x5584a5eae2f0 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 0x5584a5eb4900 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0058c0 tx=0x7f6cac09ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dfe9345b10555a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6c9dffb640 1 -- 172.21.15.83:0/2023087179 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac020040 con 0x5584a5eae2f0 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6c9dffb640 1 -- 172.21.15.83:0/2023087179 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cac009de0 con 0x5584a5eae2f0 2024-09-19T09:02:52.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.962+0000 7f6c9dffb640 1 -- 172.21.15.83:0/2023087179 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0860c0 con 0x5584a5eae2f0 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 -- 172.21.15.83:0/2023087179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 msgr2=0x5584a5eb4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 0x5584a5eb4900 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0058c0 tx=0x7f6cac09ffd0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 -- 172.21.15.83:0/2023087179 shutdown_connections 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eb8bb0 0x5584a5eb6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eae2f0 0x5584a5eb4900 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/2023087179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 -- 172.21.15.83:0/2023087179 >> 172.21.15.83:0/2023087179 conn(0x5584a5ea9f60 msgr2=0x5584a5eaa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 -- 172.21.15.83:0/2023087179 shutdown_connections 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 -- 172.21.15.83:0/2023087179 wait complete. 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.963+0000 7f6cc0d05740 1 -- start start 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 Processor -- start 2024-09-19T09:02:52.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eae2f0 0x5584a5ecc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ecc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ecaa40 con 0x5584a5eb8bb0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5584a5eca370 con 0x5584a5eae2f0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5584a5ecb110 con 0x5584a5ead9d0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cc0d05740 10 client.0 _ll_register_callbacks cb 0x7f6ca8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ecc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ecc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56900/0 (socket says 172.21.15.83:56900) 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 -- 172.21.15.83:0/3065959407 learned_addr learned my addr 172.21.15.83:0/3065959407 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cb77fe640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eae2f0 0x5584a5ecc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 -- 172.21.15.83:0/3065959407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 msgr2=0x5584a5ecbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 -- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eae2f0 msgr2=0x5584a5ecc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eae2f0 0x5584a5ecc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.964+0000 7f6cbcec9640 1 -- 172.21.15.83:0/3065959407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a5f32000 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cbcec9640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ecc880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0007a90 tx=0x7f6cb0009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fac8140ee030886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6c977fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6c977fe640 1 -- 172.21.15.83:0/3065959407 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb002b060 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6c977fe640 1 -- 172.21.15.83:0/3065959407 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6cb000a400 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cac009de0 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6c977fe640 1 -- 172.21.15.83:0/3065959407 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6cb0032050 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 10 client.15264 fetch_fsmap learned FSMap version 29 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5584a5f33360 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6c977fe640 1 -- 172.21.15.83:0/3065959407 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cac009de0 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6c977fe640 1 -- 172.21.15.83:0/3065959407 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6cb0025030 con 0x5584a5eb8bb0 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 10 client.15264 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:02:52.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 10 client.15264 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 20 client.15264 populate_metadata read hostname 'smithi083' 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5f37f80 0x5584a5f36c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 4 client.15264 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.965+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 --> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] -- command(tid 0: {"prefix": "status"}) -- 0x5584a5e1bb10 con 0x5584a5f37f80 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.966+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5f37f80 0x5584a5f36c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.966+0000 7f6c977fe640 10 client.15264 ms_handle_connect on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.966+0000 7f6cb7fff640 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5f37f80 0x5584a5f36c90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=291c2c28ccbe2aac server_cookie=4241da3159b16fb9 in_seq=0 out_seq=0 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.966+0000 7f6c977fe640 1 -- 172.21.15.83:0/3065959407 <== mds.0 v2:172.21.15.122:6838/1686011933 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5584a5e1bb10 con 0x5584a5f37f80 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.966+0000 7f6c977fe640 10 client.15264 handle_command_reply: tid=0 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.966+0000 7f6cc0d05740 1 client.15264 shutdown 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 msgr2=0x5584a5ecc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ecc880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0007a90 tx=0x7f6cb0009de0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 shutdown_connections 2024-09-19T09:02:52.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:6838/1686011933,v1:172.21.15.122:6839/1686011933] conn(0x5584a5f37f80 0x5584a5f36c90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5584a5eb8bb0 0x5584a5ecc880 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5584a5eae2f0 0x5584a5ecc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6c977fe640 0 client.15264 ms_handle_reset on v2:172.21.15.122:6838/1686011933 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 --2- 172.21.15.83:0/3065959407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5584a5ead9d0 0x5584a5ecbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 >> 172.21.15.83:0/3065959407 conn(0x5584a5ea9f60 msgr2=0x5584a5eb0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 shutdown_connections 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 1 -- 172.21.15.83:0/3065959407 wait complete. 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cc0d05740 20 client.15264 trim_cache size 0 max 16384 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "68681c4c-7664-11ef-bceb-c7b262605968", 2024-09-19T09:02:52.973 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24476, 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 134.90952120399999, 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 29, 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 89, 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 145.47467250700001 2024-09-19T09:02:52.974 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ca00a32c0 msgr2=0x7f6ca00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ca00a32c0 0x7f6ca00a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009fd0 tx=0x7f6cb0004a40 comp rx=0 tx=0).stop 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 msgr2=0x7f6cb810e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 0x7f6cb810e920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00d950 tx=0x7f6cac00de10 comp rx=0 tx=0).stop 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 shutdown_connections 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6ca00a32c0 0x7f6ca00a5780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cb8106a80 0x7f6cb810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb8101420 0x7f6cb810e920 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 --2- 172.21.15.83:0/3985025099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cb8100a80 0x7f6cb810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.967+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 >> 172.21.15.83:0/3985025099 conn(0x7f6cb80fc7a0 msgr2=0x7f6cb80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.968+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 shutdown_connections 2024-09-19T09:02:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:52.968+0000 7f6cbe92c640 1 -- 172.21.15.83:0/3985025099 wait complete. 2024-09-19T09:02:53.661 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:02:53.672 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:02:53.672 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:02:53.673 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:02:53.673 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T09:02:53.674 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:02:53.674 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:02:53.674 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 -- 172.21.15.83:0/4009596174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e58102e00 msgr2=0x7f5e58103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 --2- 172.21.15.83:0/4009596174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e58102e00 0x7f5e58103280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009900 tx=0x7f5e4002a410 comp rx=0 tx=0).stop 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 -- 172.21.15.83:0/4009596174 shutdown_connections 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 --2- 172.21.15.83:0/4009596174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e581037c0 0x7f5e5810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 --2- 172.21.15.83:0/4009596174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e58102e00 0x7f5e58103280 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 --2- 172.21.15.83:0/4009596174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e580ffe30 0x7f5e58100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 -- 172.21.15.83:0/4009596174 >> 172.21.15.83:0/4009596174 conn(0x7f5e580fb970 msgr2=0x7f5e580fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 -- 172.21.15.83:0/4009596174 shutdown_connections 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 -- 172.21.15.83:0/4009596174 wait complete. 2024-09-19T09:02:53.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 Processor -- start 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 -- start start 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 0x7f5e58197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.802+0000 7f5e5e559640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e58102e00 0x7f5e58198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e5e559640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e581037c0 0x7f5e5819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e5e559640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5810d7b0 con 0x7f5e580ffe30 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e5e559640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5810d630 con 0x7f5e581037c0 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e5e559640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5810d930 con 0x7f5e58102e00 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 0x7f5e58197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 0x7f5e58197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56916/0 (socket says 172.21.15.83:56916) 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 -- 172.21.15.83:0/1321956502 learned_addr learned my addr 172.21.15.83:0/1321956502 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 -- 172.21.15.83:0/1321956502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e58102e00 msgr2=0x7f5e58198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e58102e00 0x7f5e58198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 -- 172.21.15.83:0/1321956502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e581037c0 msgr2=0x7f5e5819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e581037c0 0x7f5e5819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 -- 172.21.15.83:0/1321956502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5819faf0 con 0x7f5e580ffe30 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e57fff640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 0x7f5e58197ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800b450 tx=0x7f5e4800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e48015020 con 0x7f5e580ffe30 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e48011d40 con 0x7f5e580ffe30 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5819fde0 con 0x7f5e580ffe30 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800f340 con 0x7f5e580ffe30 2024-09-19T09:02:53.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.803+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e581a02d0 con 0x7f5e580ffe30 2024-09-19T09:02:53.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.804+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e58109110 con 0x7f5e580ffe30 2024-09-19T09:02:53.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.805+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5e48018020 con 0x7f5e580ffe30 2024-09-19T09:02:53.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.806+0000 7f5e55ffb640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5e440a32f0 0x7f5e440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.806+0000 7f5e4ffff640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5e440a32f0 0x7f5e440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.806+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5e480cf820 con 0x7f5e580ffe30 2024-09-19T09:02:53.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.806+0000 7f5e4ffff640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5e440a32f0 0x7f5e440a57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e400096c0 tx=0x7f5e400314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:53.810+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e4801f020 con 0x7f5e580ffe30 2024-09-19T09:02:54.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:54.028+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f5e58062e90 con 0x7f5e580ffe30 2024-09-19T09:02:54.263 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:54 smithi122 ceph-mon[34247]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:02:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:54 smithi184 ceph-mon[35007]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:02:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:54 smithi083 ceph-mon[30926]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T09:02:55.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.012+0000 7f5e55ffb640 1 -- 172.21.15.83:0/1321956502 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f5e4800d040 con 0x7f5e580ffe30 2024-09-19T09:02:55.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5e440a32f0 msgr2=0x7f5e440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5e440a32f0 0x7f5e440a57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e400096c0 tx=0x7f5e400314a0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 msgr2=0x7f5e58197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 0x7f5e58197ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800b450 tx=0x7f5e4800b910 comp rx=0 tx=0).stop 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 shutdown_connections 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f5e440a32f0 0x7f5e440a57b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e581037c0 0x7f5e5819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e58102e00 0x7f5e58198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 --2- 172.21.15.83:0/1321956502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e580ffe30 0x7f5e58197ed0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 >> 172.21.15.83:0/1321956502 conn(0x7f5e580fb970 msgr2=0x7f5e581062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 shutdown_connections 2024-09-19T09:02:55.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:55.015+0000 7f5e5e559640 1 -- 172.21.15.83:0/1321956502 wait complete. 2024-09-19T09:02:55.035 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T09:02:55.047 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T09:02:55.047 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T09:02:55.047 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T09:02:55.047 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:02:55.047 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:55.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:55.048 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-19T09:02:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T09:02:55.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:55.066 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T09:02:55.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:55.132 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-19T09:02:55.258 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T09:02:55.259 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T09:02:55.259 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:02:55.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1321956502' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T09:02:55.264 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ignoring --setuser ceph since I am not root 2024-09-19T09:02:55.264 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ignoring --setgroup ceph since I am not root 2024-09-19T09:02:55.264 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:55.170+0000 7f36cd8aa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:02:55.265 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:55.231+0000 7f36cd8aa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:02:55.330 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: ignoring --setuser ceph since I am not root 2024-09-19T09:02:55.331 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: ignoring --setgroup ceph since I am not root 2024-09-19T09:02:55.331 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-mgr[35617]: -- 172.21.15.122:0/1688582640 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d5b6b30e0 con 0x557d5b691000 2024-09-19T09:02:55.331 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:55.175+0000 7f2c1bc1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:02:55.331 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:55.234+0000 7f2c1bc1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:02:55.331 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1321956502' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T09:02:55.350 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1321956502' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T09:02:55.351 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: ignoring --setuser ceph since I am not root 2024-09-19T09:02:55.351 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: ignoring --setgroup ceph since I am not root 2024-09-19T09:02:55.351 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-mgr[36818]: -- 172.21.15.184:0/3961965498 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d9067e10e0 con 0x55d9067bf400 2024-09-19T09:02:55.351 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:55.187+0000 7fca12256040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:02:55.351 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:55.246+0000 7fca12256040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:02:55.516 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:55.615 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:55.390+0000 7f2c1bc1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:02:55.615 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:55.459+0000 7f2c1bc1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:02:55.615 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:55.614+0000 7f2c1bc1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:02:55.622 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:55.390+0000 7f36cd8aa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:02:55.622 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:55.462+0000 7f36cd8aa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:02:55.622 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:55.620+0000 7f36cd8aa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:02:55.628 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:55.402+0000 7fca12256040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:02:55.628 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:55.471+0000 7fca12256040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:02:55.899 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:55.628+0000 7fca12256040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:02:55.899 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:55.771+0000 7fca12256040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:02:55.957 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:55.763+0000 7f36cd8aa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:02:55.960 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:55.761+0000 7f2c1bc1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 -- 172.21.15.83:0/3913076058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d8102d30 msgr2=0x7f34d8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 --2- 172.21.15.83:0/3913076058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d8102d30 0x7f34d8103110 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009930 tx=0x7f34cc02a420 comp rx=0 tx=0).stop 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 -- 172.21.15.83:0/3913076058 shutdown_connections 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 --2- 172.21.15.83:0/3913076058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34d81082a0 0x7f34d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 --2- 172.21.15.83:0/3913076058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d81036e0 0x7f34d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 --2- 172.21.15.83:0/3913076058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d8102d30 0x7f34d8103110 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 -- 172.21.15.83:0/3913076058 >> 172.21.15.83:0/3913076058 conn(0x7f34d80fc7d0 msgr2=0x7f34d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 -- 172.21.15.83:0/3913076058 shutdown_connections 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 -- 172.21.15.83:0/3913076058 wait complete. 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 Processor -- start 2024-09-19T09:02:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.038+0000 7f34deffa640 1 -- start start 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34deffa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d8102d30 0x7f34d8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34deffa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 0x7f34d8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34deffa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34d81082a0 0x7f34d8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34deffa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8111f50 con 0x7f34d81036e0 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34deffa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8111dd0 con 0x7f34d81082a0 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34deffa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f34d81120d0 con 0x7f34d8102d30 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 0x7f34d8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 0x7f34d8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56954/0 (socket says 172.21.15.83:56954) 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 -- 172.21.15.83:0/3294063725 learned_addr learned my addr 172.21.15.83:0/3294063725 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34dcd96640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d8102d30 0x7f34d8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34dd597640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34d81082a0 0x7f34d8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 -- 172.21.15.83:0/3294063725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d8102d30 msgr2=0x7f34d8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d8102d30 0x7f34d8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 -- 172.21.15.83:0/3294063725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34d81082a0 msgr2=0x7f34d8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34d81082a0 0x7f34d8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 -- 172.21.15.83:0/3294063725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d81a69f0 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34dcd96640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d8102d30 0x7f34d8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.039+0000 7f34d7fff640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 0x7f34d8100ed0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f34c400e9c0 tx=0x7f34c400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.040+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c400ccc0 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.040+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d81a6ce0 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.040+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34c40054d0 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.040+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4010430 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.040+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d81a71c0 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.041+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d806a850 con 0x7f34d81036e0 2024-09-19T09:02:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.042+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f34c4004f50 con 0x7f34d81036e0 2024-09-19T09:02:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.043+0000 7f34d5ffb640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 0x7f34c80a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.043+0000 7f34dcd96640 1 -- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 msgr2=0x7f34c80a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/2542755280 2024-09-19T09:02:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.043+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f34c40d0080 con 0x7f34d81036e0 2024-09-19T09:02:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.043+0000 7f34dcd96640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 0x7f34c80a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:02:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.047+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34c409ca40 con 0x7f34d81036e0 2024-09-19T09:02:56.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:56 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1321956502' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T09:02:56.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:56 smithi083 ceph-mon[30926]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T09:02:56.212 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:56 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:56.089+0000 7f36cd8aa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:02:56.212 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:56 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:56.153+0000 7f36cd8aa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:02:56.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.244+0000 7f34dcd96640 1 -- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 msgr2=0x7f34c80a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/2542755280 2024-09-19T09:02:56.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.244+0000 7f34dcd96640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 0x7f34c80a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:02:56.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.261+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f34d810a2b0 con 0x7f34d81036e0 2024-09-19T09:02:56.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.262+0000 7f34d5ffb640 1 -- 172.21.15.83:0/3294063725 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f34c409c340 con 0x7f34d81036e0 2024-09-19T09:02:56.262 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T09:02:56.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 msgr2=0x7f34c80a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:02:56.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 0x7f34c80a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 msgr2=0x7f34d8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 0x7f34d8100ed0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f34c400e9c0 tx=0x7f34c400edc0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 shutdown_connections 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f34c80a3290 0x7f34c80a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34d81082a0 0x7f34d8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34d81036e0 0x7f34d8100ed0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 --2- 172.21.15.83:0/3294063725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34d8102d30 0x7f34d8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 >> 172.21.15.83:0/3294063725 conn(0x7f34d80fc7d0 msgr2=0x7f34d8105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 shutdown_connections 2024-09-19T09:02:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:56.264+0000 7f34deffa640 1 -- 172.21.15.83:0/3294063725 wait complete. 2024-09-19T09:02:56.323 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:56 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1321956502' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T09:02:56.323 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:56 smithi122 ceph-mon[34247]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T09:02:56.323 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:56 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:56.083+0000 7f2c1bc1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:02:56.323 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:56 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:56.146+0000 7f2c1bc1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:02:56.336 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:56 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1321956502' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T09:02:56.336 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:56 smithi184 ceph-mon[35007]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T09:02:56.336 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:56 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:56.089+0000 7fca12256040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:02:56.336 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:56 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:56.150+0000 7fca12256040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:02:56.627 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:56 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:56.353+0000 7f36cd8aa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:02:56.649 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:56 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:56.339+0000 7fca12256040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:02:56.710 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:56 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:56.338+0000 7f2c1bc1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:02:56.967 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:02:56.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:56.968 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-19T09:02:56.984 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:02:56.984 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:02:56.985 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:02:56.986 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:02:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:02:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:02:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42189sec preferred_lft 42189sec 2024-09-19T09:02:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-19T09:02:56.986 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:02:56.986 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:02:56.986 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:02:56.986 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:02:56.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:02:56.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-09-19T09:02:56.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-09-19T09:02:56.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:02:56.987 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:02:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:02:57.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:02:57.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:57.127 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:02:57.150 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-19T09:02:57.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:57.152 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-19T09:02:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-19T09:02:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:02:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:02:57.209 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:02:57.209 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:02:57.209 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:02:57.209 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:02:57.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:02:57.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:02:57.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:02:57.209 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:02:57.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:57 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3294063725' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:02:57.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:02:57.284 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:57 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3294063725' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:02:57.285 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:57 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:57.217+0000 7f2c1bc1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:02:57.285 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:57 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:57.284+0000 7f2c1bc1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:02:57.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:02:57.293 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:57 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3294063725' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:02:57.293 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:57 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:57.224+0000 7fca12256040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:02:57.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:57.298 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-19T09:02:57.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:57.314 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-19T09:02:57.369 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:02:57.369 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:02:57.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:57.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:02:57.369 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:02:57.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:02:57.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:02:57.489 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:02:57.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:02:57.490 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:02:57.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:02:57.546 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:57.286+0000 7f36cd8aa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:02:57.546 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:57.356+0000 7f36cd8aa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:02:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:02:57.604 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:02:57.605 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-19T09:02:57.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-19T09:02:57.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:02:57.605 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-19T09:02:57.649 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:57 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:57.293+0000 7fca12256040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:02:57.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:02:57.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:02:57.684 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T09:02:57.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:02:57.685 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:57.699 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:02:57.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:02:57.700 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:57.755 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-19T09:02:57.822 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:02:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-19T09:02:57.879 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:02:57.880 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:02:57.881 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a94076573254de4ee7877abdca91a9fbcd8633397bc24587600354963a49b78/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b2b9f52c14d141656fa551307d0ddde5b5005d513d8f31f3f2c12e2cf80951e0/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/879e9c96c4b0890cc1c6cb240f1d5177aefbd36f3d4013329d6713ec5f41a365/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/68008f9fe1b27ed5a97122982ca3c24a773a950dcb50473c6f338a7c5ca8dceb/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/7bb2bd87d5865fa33e7d4c6c950a06da4371e0a9926ec60b51d75a9a2f5b2fc8/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a35844aba5fe83ed148afdca6b7bb0cbe8c7e918c6c5049cd982e4c8640b18e/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/cd3b3ca72de89aa96a5bee33b0a627cd7501db9051ef2384729f17624a0f0621/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/dde44b704ca8b52479bb05f6c25a7896c615208097c752e75c00f38642d0522b/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f55040730f2aee6c2f43802dc1b3c6ac0dd51388b2c5b9661af838c2ad18931a/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/3b56e8a0a085a9aa2d47c664e8be96d2f324a3cfe3f752d39dc03ee358762263/merged 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:57.882 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:57.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:57.883 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-19T09:02:57.935 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T09:02:57.936 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/ed5b2424-aa41-4ad3-9952-2bbdaa8a1220 --client_fs=cephfs) 2024-09-19T09:02:57.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-19T09:02:58.003 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-19T09:02:58.060 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:02:58.061 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a94076573254de4ee7877abdca91a9fbcd8633397bc24587600354963a49b78/merged 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b2b9f52c14d141656fa551307d0ddde5b5005d513d8f31f3f2c12e2cf80951e0/merged 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/879e9c96c4b0890cc1c6cb240f1d5177aefbd36f3d4013329d6713ec5f41a365/merged 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/68008f9fe1b27ed5a97122982ca3c24a773a950dcb50473c6f338a7c5ca8dceb/merged 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/7bb2bd87d5865fa33e7d4c6c950a06da4371e0a9926ec60b51d75a9a2f5b2fc8/merged 2024-09-19T09:02:58.062 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a35844aba5fe83ed148afdca6b7bb0cbe8c7e918c6c5049cd982e4c8640b18e/merged 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/cd3b3ca72de89aa96a5bee33b0a627cd7501db9051ef2384729f17624a0f0621/merged 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/dde44b704ca8b52479bb05f6c25a7896c615208097c752e75c00f38642d0522b/merged 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f55040730f2aee6c2f43802dc1b3c6ac0dd51388b2c5b9661af838c2ad18931a/merged 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/3b56e8a0a085a9aa2d47c664e8be96d2f324a3cfe3f752d39dc03ee358762263/merged 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:58.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:58.063 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-19T09:02:58.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:2024-09-19T09:02:58.062+0000 7f2ded417480 -1 init, newargv = 0x5597ca7b4a80 newargc=15 2024-09-19T09:02:58.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[83249]: starting ceph client 2024-09-19T09:02:58.080 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[83249]: starting fuse 2024-09-19T09:02:58.255 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:57 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:57.992+0000 7f2c1bc1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:02:58.255 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.112+0000 7f2c1bc1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:02:58.267 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.004+0000 7fca12256040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:02:58.267 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.123+0000 7fca12256040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:02:58.372 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.113+0000 7f36cd8aa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:02:58.372 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.229+0000 7f36cd8aa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:02:58.536 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.255+0000 7f2c1bc1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:02:58.536 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.317+0000 7f2c1bc1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:02:58.536 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.468+0000 7f2c1bc1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:02:58.536 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.536+0000 7f2c1bc1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:02:58.547 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.267+0000 7fca12256040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:02:58.547 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.329+0000 7fca12256040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:02:58.547 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.479+0000 7fca12256040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:02:58.547 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.547+0000 7fca12256040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:02:58.650 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.372+0000 7f36cd8aa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:02:58.650 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.432+0000 7f36cd8aa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:02:58.650 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.582+0000 7f36cd8aa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:02:58.650 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.649+0000 7f36cd8aa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:02:58.821 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.596+0000 7f2c1bc1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:02:58.821 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.756+0000 7f2c1bc1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:02:58.821 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.821+0000 7f2c1bc1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:02:58.832 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.607+0000 7fca12256040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:02:58.832 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.767+0000 7fca12256040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:02:58.931 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.709+0000 7f36cd8aa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:02:58.931 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.867+0000 7f36cd8aa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:02:58.931 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.931+0000 7f36cd8aa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:02:59.089 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.887+0000 7f2c1bc1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:02:59.089 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:58.969+0000 7f2c1bc1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:02:59.089 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:59.027+0000 7f2c1bc1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:02:59.089 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:59.089+0000 7f2c1bc1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:02:59.104 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.832+0000 7fca12256040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:02:59.104 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.898+0000 7fca12256040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:02:59.104 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:58.981+0000 7fca12256040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:02:59.104 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:59.042+0000 7fca12256040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:02:59.104 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:59.104+0000 7fca12256040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:02:59.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-19T09:02:59.200 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:58.997+0000 7f36cd8aa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:02:59.200 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:59.081+0000 7f36cd8aa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:02:59.200 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:59.140+0000 7f36cd8aa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:02:59.200 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:02:59.199+0000 7f36cd8aa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:02:59.208 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:02:59.264 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-19T09:02:59.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-19T09:02:59.264 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-19T09:02:59.265 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a94076573254de4ee7877abdca91a9fbcd8633397bc24587600354963a49b78/merged 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b2b9f52c14d141656fa551307d0ddde5b5005d513d8f31f3f2c12e2cf80951e0/merged 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-19T09:02:59.266 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/879e9c96c4b0890cc1c6cb240f1d5177aefbd36f3d4013329d6713ec5f41a365/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/68008f9fe1b27ed5a97122982ca3c24a773a950dcb50473c6f338a7c5ca8dceb/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/7bb2bd87d5865fa33e7d4c6c950a06da4371e0a9926ec60b51d75a9a2f5b2fc8/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/4a35844aba5fe83ed148afdca6b7bb0cbe8c7e918c6c5049cd982e4c8640b18e/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/cd3b3ca72de89aa96a5bee33b0a627cd7501db9051ef2384729f17624a0f0621/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/dde44b704ca8b52479bb05f6c25a7896c615208097c752e75c00f38642d0522b/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f55040730f2aee6c2f43802dc1b3c6ac0dd51388b2c5b9661af838c2ad18931a/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/3b56e8a0a085a9aa2d47c664e8be96d2f324a3cfe3f752d39dc03ee358762263/merged 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:02:59.267 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:59.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:59.268 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-19T09:02:59.320 INFO:teuthology.orchestra.run.smithi083.stdout:120 2024-09-19T09:02:59.321 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-09-19T09:02:59.321 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T09:02:59.322 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-19T09:02:59.323 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.0")) 2024-09-19T09:02:59.323 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-09-19T09:02:59.441 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.0.83249.asok 2024-09-19T09:02:59.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:02:59.451 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.83249.asok 2024-09-19T09:02:59.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:59.452 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.83249.asok status 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "0", 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "83249", 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/volumes/qa/sv_0/ed5b2424-aa41-4ad3-9952-2bbdaa8a1220" 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-09-19T09:02:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 15300, 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 15300 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1708007309 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-19T09:02:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1708007309 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.15300 192.168.0.1:0/1708007309", 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/1708007309", 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 5, 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 29, 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 89, 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-09-19T09:02:59.589 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:02:59.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:59.596 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-09-19T09:02:59.596 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:59.611 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-09-19T09:02:59.611 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:59.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:02:59.612 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:02:59.678 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:02:59.687 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:02:59.687 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:02:59.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 -- 172.21.15.83:0/393618833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 msgr2=0x7f6e64108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 --2- 172.21.15.83:0/393618833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64108e90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009ca0 tx=0x7f6e5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 -- 172.21.15.83:0/393618833 shutdown_connections 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 --2- 172.21.15.83:0/393618833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64108e90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 --2- 172.21.15.83:0/393618833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64101c40 0x7f6e641020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 --2- 172.21.15.83:0/393618833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64100a50 0x7f6e64100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 -- 172.21.15.83:0/393618833 >> 172.21.15.83:0/393618833 conn(0x7f6e640fc1f0 msgr2=0x7f6e640fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 -- 172.21.15.83:0/393618833 shutdown_connections 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.822+0000 7f6e694a5640 1 -- 172.21.15.83:0/393618833 wait complete. 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 Processor -- start 2024-09-19T09:02:59.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 -- start start 2024-09-19T09:02:59.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64100a50 0x7f6e641049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64101c40 0x7f6e64103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6410c5d0 con 0x7f6e64102600 2024-09-19T09:02:59.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6410c450 con 0x7f6e64101c40 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e694a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6410c750 con 0x7f6e64100a50 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e637fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e637fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64103560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56968/0 (socket says 172.21.15.83:56968) 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e637fe640 1 -- 172.21.15.83:0/1700958810 learned_addr learned my addr 172.21.15.83:0/1700958810 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e627fc640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64101c40 0x7f6e64103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.823+0000 7f6e62ffd640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64100a50 0x7f6e641049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e637fe640 1 -- 172.21.15.83:0/1700958810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64100a50 msgr2=0x7f6e641049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e637fe640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64100a50 0x7f6e641049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e637fe640 1 -- 172.21.15.83:0/1700958810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64101c40 msgr2=0x7f6e64103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e637fe640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64101c40 0x7f6e64103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e637fe640 1 -- 172.21.15.83:0/1700958810 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e64103df0 con 0x7f6e64102600 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e62ffd640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64100a50 0x7f6e641049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:59.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e627fc640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64101c40 0x7f6e64103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e637fe640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64103560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c031040 tx=0x7f6e5c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0317c0 con 0x7f6e64102600 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e5c0044f0 con 0x7f6e64102600 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e641a1e10 con 0x7f6e64102600 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c030b40 con 0x7f6e64102600 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.824+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e641a2270 con 0x7f6e64102600 2024-09-19T09:02:59.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.825+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e641a2530 con 0x7f6e64102600 2024-09-19T09:02:59.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.826+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f6e5c030ce0 con 0x7f6e64102600 2024-09-19T09:02:59.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.827+0000 7f6e5bfff640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 0x7f6e500a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.827+0000 7f6e62ffd640 1 -- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 msgr2=0x7f6e500a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/2542755280 2024-09-19T09:02:59.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.827+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6e5c0f0fe0 con 0x7f6e64102600 2024-09-19T09:02:59.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.827+0000 7f6e62ffd640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 0x7f6e500a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:02:59.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.831+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e5c0bd9a0 con 0x7f6e64102600 2024-09-19T09:02:59.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:02:59.949+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 20) ==== 138372+0+0 (secure 0 0 0) 0x7f6e5c0b9910 con 0x7f6e64102600 2024-09-19T09:03:00.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:00.028+0000 7f6e62ffd640 1 -- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 msgr2=0x7f6e500a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/2542755280 2024-09-19T09:03:00.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:00.028+0000 7f6e62ffd640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 0x7f6e500a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:03:00.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: Standby manager daemon y restarted 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: Standby manager daemon y started 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: Standby manager daemon z restarted 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: Standby manager daemon z started 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:03:00.036 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:02:59 smithi083 ceph-mon[30926]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:00.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:00.048+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7f6e5c0bc6f0 con 0x7f6e64102600 2024-09-19T09:03:00.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:00.049+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 msgr2=0x7f6e500a5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:03:00.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:00.049+0000 7f6e5bfff640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 0x7f6e500a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:00.050+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f6e641a2700 con 0x7f6e64102600 2024-09-19T09:03:00.149 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z[36813]: 2024-09-19T09:02:59.895+0000 7fca12256040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:03:00.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: Standby manager daemon y restarted 2024-09-19T09:03:00.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: Standby manager daemon y started 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: Standby manager daemon z restarted 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: Standby manager daemon z started 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:03:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:02:59 smithi184 ceph-mon[35007]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:00.210 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y[35613]: 2024-09-19T09:02:59.885+0000 7f2c1bc1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: Standby manager daemon y restarted 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: Standby manager daemon y started 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.122:0/4186931479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: Standby manager daemon z restarted 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: Standby manager daemon z started 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:03:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:02:59 smithi122 ceph-mon[34247]: from='mgr.? 172.21.15.184:0/2952960331' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:00.313 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.035+0000 7f36cd8aa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:03:00.313 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.282+0000 7f363697f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.313 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.282+0000 7f363697f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.313 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.282+0000 7f363697f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.313 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.282+0000 7f363697f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.314 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.282+0000 7f363697f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.314 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.284+0000 7f363517c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.314 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.284+0000 7f363517c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.314 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.284+0000 7f363517c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.314 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.284+0000 7f363517c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:00.314 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:00.284+0000 7f363517c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:01.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.041+0000 7f6e5bfff640 1 -- 172.21.15.83:0/1700958810 <== mon.0 v2:172.21.15.83:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v30) ==== 117+0+0 (secure 0 0 0) 0x7f6e5c0e5000 con 0x7f6e64102600 2024-09-19T09:03:01.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 msgr2=0x7f6e64103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64103560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c031040 tx=0x7f6e5c003ba0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 shutdown_connections 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:6800/2542755280,v1:172.21.15.83:6801/2542755280] conn(0x7f6e500a3340 0x7f6e500a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e64102600 0x7f6e64103560 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e64101c40 0x7f6e64103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 --2- 172.21.15.83:0/1700958810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e64100a50 0x7f6e641049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 >> 172.21.15.83:0/1700958810 conn(0x7f6e640fc1f0 msgr2=0x7f6e640fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 shutdown_connections 2024-09-19T09:03:01.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.044+0000 7f6e694a5640 1 -- 172.21.15.83:0/1700958810 wait complete. 2024-09-19T09:03:01.057 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:03:01.068 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:03:01.110 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:03:01.110 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:03:01.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T09:03:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-19T09:03:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: Active manager daemon x restarted 2024-09-19T09:03:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: Activating manager daemon x 2024-09-19T09:03:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T09:03:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: mgrmap e21: x(active, starting, since 0.0124506s), standbys: y, z 2024-09-19T09:03:01.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1700958810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:03:01.212 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:03:01.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: Manager daemon x is now available 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:00 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: Active manager daemon x restarted 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: Activating manager daemon x 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: mgrmap e21: x(active, starting, since 0.0124506s), standbys: y, z 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1700958810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:03:01.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:03:01.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:03:01.217 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: Manager daemon x is now available 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:01.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:00 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:01.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 -- 172.21.15.83:0/615472395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec100cd0 msgr2=0x7f07ec101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/615472395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec100cd0 0x7f07ec101150 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009900 tx=0x7f07d802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 -- 172.21.15.83:0/615472395 shutdown_connections 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/615472395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07ec101690 0x7f07ec108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/615472395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec100cd0 0x7f07ec101150 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/615472395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07ec102030 0x7f07ec102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.217+0000 7f07f2c1e640 1 -- 172.21.15.83:0/615472395 >> 172.21.15.83:0/615472395 conn(0x7f07ec0fb930 msgr2=0x7f07ec0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 -- 172.21.15.83:0/615472395 shutdown_connections 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 -- 172.21.15.83:0/615472395 wait complete. 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 Processor -- start 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 -- start start 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07ec100cd0 0x7f07ec197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07ec101690 0x7f07ec198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.218+0000 7f07f2c1e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 0x7f07ec19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f2c1e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec10d6c0 con 0x7f07ec102030 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f2c1e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec10d540 con 0x7f07ec100cd0 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f2c1e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec10d840 con 0x7f07ec101690 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 0x7f07ec19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 0x7f07ec19f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49834/0 (socket says 172.21.15.83:49834) 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 -- 172.21.15.83:0/2226696815 learned_addr learned my addr 172.21.15.83:0/2226696815 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f09ba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07ec100cd0 0x7f07ec197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07ebfff640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07ec101690 0x7f07ec198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 -- 172.21.15.83:0/2226696815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07ec101690 msgr2=0x7f07ec198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07ec101690 0x7f07ec198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 -- 172.21.15.83:0/2226696815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07ec100cd0 msgr2=0x7f07ec197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07ec100cd0 0x7f07ec197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 -- 172.21.15.83:0/2226696815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec19f960 con 0x7f07ec102030 2024-09-19T09:03:01.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.219+0000 7f07f11bb640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 0x7f07ec19f2c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f07e400eb10 tx=0x7f07e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.220+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4004b20 con 0x7f07ec102030 2024-09-19T09:03:01.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.220+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec19fc50 con 0x7f07ec102030 2024-09-19T09:03:01.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.220+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07e4004cc0 con 0x7f07ec102030 2024-09-19T09:03:01.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.220+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4010690 con 0x7f07ec102030 2024-09-19T09:03:01.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.220+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec1a01a0 con 0x7f07ec102030 2024-09-19T09:03:01.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.221+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ec107f30 con 0x7f07ec102030 2024-09-19T09:03:01.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.222+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f07e4005020 con 0x7f07ec102030 2024-09-19T09:03:01.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.223+0000 7f07e9ffb640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07dc0a3100 0x7f07dc0a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.223+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f07e40d00a0 con 0x7f07ec102030 2024-09-19T09:03:01.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.223+0000 7f07f09ba640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07dc0a3100 0x7f07dc0a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.223+0000 7f07f09ba640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07dc0a3100 0x7f07dc0a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07ec199220 tx=0x7f07e0005f90 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.228+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07e409cc50 con 0x7f07ec102030 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: Active manager daemon x restarted 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: Activating manager daemon x 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: mgrmap e21: x(active, starting, since 0.0124506s), standbys: y, z 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1700958810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:03:01.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:03:01.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:03:01.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: Manager daemon x is now available 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:01.325 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:00 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:01.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.426+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f07ec02d7c0 con 0x7f07ec102030 2024-09-19T09:03:01.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.430+0000 7f07e9ffb640 1 -- 172.21.15.83:0/2226696815 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f07ec02d7c0 con 0x7f07ec102030 2024-09-19T09:03:01.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07dc0a3100 msgr2=0x7f07dc0a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07dc0a3100 0x7f07dc0a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07ec199220 tx=0x7f07e0005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 msgr2=0x7f07ec19f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 0x7f07ec19f2c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f07e400eb10 tx=0x7f07e400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 shutdown_connections 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec102030 0x7f07ec19f2c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07dc0a3100 0x7f07dc0a55c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07ec101690 0x7f07ec198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 --2- 172.21.15.83:0/2226696815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07ec100cd0 0x7f07ec197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 >> 172.21.15.83:0/2226696815 conn(0x7f07ec0fb930 msgr2=0x7f07ec105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 shutdown_connections 2024-09-19T09:03:01.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.432+0000 7f07f2c1e640 1 -- 172.21.15.83:0/2226696815 wait complete. 2024-09-19T09:03:01.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 -- 172.21.15.83:0/31868687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6941025f0 msgr2=0x7fe694108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/31868687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6941025f0 0x7fe694108e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009ca0 tx=0x7fe68c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 -- 172.21.15.83:0/31868687 shutdown_connections 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/31868687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6941025f0 0x7fe694108e80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/31868687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694101c30 0x7fe6941020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/31868687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe694100a40 0x7fe694100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 -- 172.21.15.83:0/31868687 >> 172.21.15.83:0/31868687 conn(0x7fe6940fc1e0 msgr2=0x7fe6940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 -- 172.21.15.83:0/31868687 shutdown_connections 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 -- 172.21.15.83:0/31868687 wait complete. 2024-09-19T09:03:01.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 Processor -- start 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.546+0000 7fe69c4a5640 1 -- start start 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 0x7fe694197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe694101c30 0x7fe6941981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6941025f0 0x7fe69419f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe69410c570 con 0x7fe694100a40 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe69410c3f0 con 0x7fe694101c30 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe69410c6f0 con 0x7fe6941025f0 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 0x7fe694197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 0x7fe694197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49856/0 (socket says 172.21.15.83:49856) 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 -- 172.21.15.83:0/2141807902 learned_addr learned my addr 172.21.15.83:0/2141807902 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe699a40640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe694101c30 0x7fe6941981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69aa42640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6941025f0 0x7fe69419f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 -- 172.21.15.83:0/2141807902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6941025f0 msgr2=0x7fe69419f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6941025f0 0x7fe69419f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 -- 172.21.15.83:0/2141807902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe694101c30 msgr2=0x7fe6941981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe694101c30 0x7fe6941981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 -- 172.21.15.83:0/2141807902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69419f8e0 con 0x7fe694100a40 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69a241640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 0x7fe694197ca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe69000e9c0 tx=0x7fe69000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69000cd80 con 0x7fe694100a40 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69419fbd0 con 0x7fe694100a40 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6900035f0 con 0x7fe694100a40 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690010690 con 0x7fe694100a40 2024-09-19T09:03:01.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.547+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6941a0120 con 0x7fe694100a40 2024-09-19T09:03:01.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.548+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6941a02f0 con 0x7fe694100a40 2024-09-19T09:03:01.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.549+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7fe6900037a0 con 0x7fe694100a40 2024-09-19T09:03:01.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.550+0000 7fe6877fe640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fe6800a3100 0x7fe6800a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.550+0000 7fe699a40640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fe6800a3100 0x7fe6800a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.550+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fe6900cffe0 con 0x7fe694100a40 2024-09-19T09:03:01.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.551+0000 7fe699a40640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fe6800a3100 0x7fe6800a55c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6941991a0 tx=0x7fe688005f90 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.554+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe69009cb90 con 0x7fe694100a40 2024-09-19T09:03:01.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.738+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fe6941a04c0 con 0x7fe694100a40 2024-09-19T09:03:01.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.741+0000 7fe6877fe640 1 -- 172.21.15.83:0/2141807902 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7fe69009c490 con 0x7fe694100a40 2024-09-19T09:03:01.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fe6800a3100 msgr2=0x7fe6800a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fe6800a3100 0x7fe6800a55c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6941991a0 tx=0x7fe688005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 msgr2=0x7fe694197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 0x7fe694197ca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe69000e9c0 tx=0x7fe69000ee80 comp rx=0 tx=0).stop 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 shutdown_connections 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fe6800a3100 0x7fe6800a55c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6941025f0 0x7fe69419f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe694101c30 0x7fe6941981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 --2- 172.21.15.83:0/2141807902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe694100a40 0x7fe694197ca0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 >> 172.21.15.83:0/2141807902 conn(0x7fe6940fc1e0 msgr2=0x7fe6940fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 shutdown_connections 2024-09-19T09:03:01.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.744+0000 7fe69c4a5640 1 -- 172.21.15.83:0/2141807902 wait complete. 2024-09-19T09:03:01.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T09:03:01.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 -- 172.21.15.83:0/3761981292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec101b60 msgr2=0x7fa5ec101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 --2- 172.21.15.83:0/3761981292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec101b60 0x7fa5ec101f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009900 tx=0x7fa5e002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 -- 172.21.15.83:0/3761981292 shutdown_connections 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 --2- 172.21.15.83:0/3761981292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec103710 0x7fa5ec109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 --2- 172.21.15.83:0/3761981292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 --2- 172.21.15.83:0/3761981292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec101b60 0x7fa5ec101f60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 -- 172.21.15.83:0/3761981292 >> 172.21.15.83:0/3761981292 conn(0x7fa5ec0fd2c0 msgr2=0x7fa5ec0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 -- 172.21.15.83:0/3761981292 shutdown_connections 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.865+0000 7fa5f2047640 1 -- 172.21.15.83:0/3761981292 wait complete. 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 Processor -- start 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 -- start start 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec101b60 0x7fa5ec199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 0x7fa5ec1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec10f8f0 con 0x7fa5ec103710 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec10f770 con 0x7fa5ec102d50 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5f2047640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec10fa70 con 0x7fa5ec101b60 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5ebfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 0x7fa5ec1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5eaffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5ebfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 0x7fa5ec1a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49866/0 (socket says 172.21.15.83:49866) 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5eaffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.83:53170/0 (socket says 172.21.15.83:53170) 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5ebfff640 1 -- 172.21.15.83:0/2075610407 learned_addr learned my addr 172.21.15.83:0/2075610407 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.866+0000 7fa5eb7fe640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec101b60 0x7fa5ec199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5ebfff640 1 -- 172.21.15.83:0/2075610407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec101b60 msgr2=0x7fa5ec199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5ebfff640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec101b60 0x7fa5ec199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5ebfff640 1 -- 172.21.15.83:0/2075610407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 msgr2=0x7fa5ec19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5ebfff640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5ebfff640 1 -- 172.21.15.83:0/2075610407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec1a1be0 con 0x7fa5ec103710 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5eaffd640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5ebfff640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 0x7fa5ec1a1570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009fd0 tx=0x7fa5e400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4017070 con 0x7fa5ec103710 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec1a1ed0 con 0x7fa5ec103710 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e4003e20 con 0x7fa5ec103710 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4010460 con 0x7fa5ec103710 2024-09-19T09:03:01.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.867+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec1a2390 con 0x7fa5ec103710 2024-09-19T09:03:01.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.868+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ec108ff0 con 0x7fa5ec103710 2024-09-19T09:03:01.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.869+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7fa5e4003970 con 0x7fa5ec103710 2024-09-19T09:03:01.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.870+0000 7fa5e8ff9640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa5d40a3100 0x7fa5d40a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.870+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa5e40cf710 con 0x7fa5ec103710 2024-09-19T09:03:01.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.870+0000 7fa5eb7fe640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa5d40a3100 0x7fa5d40a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.870+0000 7fa5eb7fe640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa5d40a3100 0x7fa5d40a55c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000c00 tx=0x7fa5e00314a0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:01.874+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5e409bc70 con 0x7fa5ec103710 2024-09-19T09:03:02.043 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:01.808+0000 7f36210d5640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:03:01] ENGINE Error in HTTPServer.serve 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: Traceback (most recent call last): 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._connections.run(self.expiration_interval) 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._run(expiration_interval) 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:03:02.044 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: s = self.context.wrap_socket( 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: return self.sslsocket_class._create( 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self.do_handshake() 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: self._sslobj.do_handshake() 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:03:02.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:03:01 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:03:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.070+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa5ec02d7c0 con 0x7fa5ec103710 2024-09-19T09:03:02.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.074+0000 7fa5e8ff9640 1 -- 172.21.15.83:0/2075610407 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7fa5e409ff70 con 0x7fa5ec103710 2024-09-19T09:03:02.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa5d40a3100 msgr2=0x7fa5d40a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa5d40a3100 0x7fa5d40a55c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000c00 tx=0x7fa5e00314a0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 msgr2=0x7fa5ec1a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 0x7fa5ec1a1570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009fd0 tx=0x7fa5e400b260 comp rx=0 tx=0).stop 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 shutdown_connections 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa5ec103710 0x7fa5ec1a1570 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5ec102d50 0x7fa5ec19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa5d40a3100 0x7fa5d40a55c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 --2- 172.21.15.83:0/2075610407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec101b60 0x7fa5ec199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 >> 172.21.15.83:0/2075610407 conn(0x7fa5ec0fd2c0 msgr2=0x7fa5ec1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 shutdown_connections 2024-09-19T09:03:02.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.076+0000 7fa5f2047640 1 -- 172.21.15.83:0/2075610407 wait complete. 2024-09-19T09:03:02.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T09:03:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 -- 172.21.15.83:0/1841445227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 msgr2=0x7f379c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 --2- 172.21.15.83:0/1841445227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c1049b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3798009900 tx=0x7f379802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 -- 172.21.15.83:0/1841445227 shutdown_connections 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 --2- 172.21.15.83:0/1841445227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f379c107820 0x7f379c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 --2- 172.21.15.83:0/1841445227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c104ef0 0x7f379c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 --2- 172.21.15.83:0/1841445227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c1049b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 -- 172.21.15.83:0/1841445227 >> 172.21.15.83:0/1841445227 conn(0x7f379c0fc1e0 msgr2=0x7f379c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 -- 172.21.15.83:0/1841445227 shutdown_connections 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.194+0000 7f37a41e8640 1 -- 172.21.15.83:0/1841445227 wait complete. 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 Processor -- start 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 -- start start 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c104ef0 0x7f379c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f379c107820 0x7f379c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f379c10d6b0 con 0x7f379c1025c0 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f379c10d530 con 0x7f379c107820 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a41e8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f379c10d830 con 0x7f379c104ef0 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49910/0 (socket says 172.21.15.83:49910) 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 -- 172.21.15.83:0/3688864237 learned_addr learned my addr 172.21.15.83:0/3688864237 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1783640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c104ef0 0x7f379c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a2785640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f379c107820 0x7f379c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 -- 172.21.15.83:0/3688864237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c104ef0 msgr2=0x7f379c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c104ef0 0x7f379c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 -- 172.21.15.83:0/3688864237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f379c107820 msgr2=0x7f379c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f379c107820 0x7f379c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.195+0000 7f37a1f84640 1 -- 172.21.15.83:0/3688864237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c19f9c0 con 0x7f379c1025c0 2024-09-19T09:03:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.196+0000 7f37a1f84640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c197db0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3798004770 tx=0x7f37980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.196+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379803f030 con 0x7f379c1025c0 2024-09-19T09:03:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.196+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c19fc50 con 0x7f379c1025c0 2024-09-19T09:03:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.196+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3798003cb0 con 0x7f379c1025c0 2024-09-19T09:03:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.196+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798035070 con 0x7f379c1025c0 2024-09-19T09:03:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.196+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1a0140 con 0x7f379c1025c0 2024-09-19T09:03:02.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.197+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379c0fdcd0 con 0x7f379c1025c0 2024-09-19T09:03:02.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.198+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f3798042030 con 0x7f379c1025c0 2024-09-19T09:03:02.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.199+0000 7f3792ffd640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f37880a3100 0x7f37880a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.199+0000 7f37a1783640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f37880a3100 0x7f37880a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.199+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f37980f0420 con 0x7f379c1025c0 2024-09-19T09:03:02.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.199+0000 7f37a1783640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f37880a3100 0x7f37880a55c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f378c005d00 tx=0x7f378c00b410 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.206+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37980bca50 con 0x7f379c1025c0 2024-09-19T09:03:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1700958810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:03:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:03:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: mgrmap e22: x(active, since 1.02576s), standbys: y, z 2024-09-19T09:03:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2226696815' entity='client.admin' 2024-09-19T09:03:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2141807902' entity='client.admin' 2024-09-19T09:03:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:02 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.402+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 --> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f379c062630 con 0x7f37880a3100 2024-09-19T09:03:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1700958810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: mgrmap e22: x(active, since 1.02576s), standbys: y, z 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2226696815' entity='client.admin' 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2141807902' entity='client.admin' 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:02 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1700958810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: mgrmap e22: x(active, since 1.02576s), standbys: y, z 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2226696815' entity='client.admin' 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2141807902' entity='client.admin' 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:02 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:02.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.487+0000 7f3792ffd640 1 -- 172.21.15.83:0/3688864237 <== mgr.15288 v2:172.21.15.83:6800/2671255807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f379c062630 con 0x7f37880a3100 2024-09-19T09:03:02.487 INFO:teuthology.orchestra.run.smithi083.stdout:Schedule set for path / 2024-09-19T09:03:02.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f37880a3100 msgr2=0x7f37880a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f37880a3100 0x7f37880a55c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f378c005d00 tx=0x7f378c00b410 comp rx=0 tx=0).stop 2024-09-19T09:03:02.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 msgr2=0x7f379c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c197db0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3798004770 tx=0x7f37980042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 shutdown_connections 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f379c107820 0x7f379c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f37880a3100 0x7f37880a55c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c104ef0 0x7f379c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 --2- 172.21.15.83:0/3688864237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c1025c0 0x7f379c197db0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 >> 172.21.15.83:0/3688864237 conn(0x7f379c0fc1e0 msgr2=0x7f379c103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 shutdown_connections 2024-09-19T09:03:02.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.489+0000 7f37a41e8640 1 -- 172.21.15.83:0/3688864237 wait complete. 2024-09-19T09:03:02.501 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T09:03:02.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 -- 172.21.15.83:0/98854472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c1025f0 msgr2=0x7f8b4c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 --2- 172.21.15.83:0/98854472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c1025f0 0x7f8b4c108e80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009ca0 tx=0x7f8b3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 -- 172.21.15.83:0/98854472 shutdown_connections 2024-09-19T09:03:02.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 --2- 172.21.15.83:0/98854472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c1025f0 0x7f8b4c108e80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 --2- 172.21.15.83:0/98854472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 0x7f8b4c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 --2- 172.21.15.83:0/98854472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b4c100a40 0x7f8b4c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 -- 172.21.15.83:0/98854472 >> 172.21.15.83:0/98854472 conn(0x7f8b4c0fc1e0 msgr2=0x7f8b4c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 -- 172.21.15.83:0/98854472 shutdown_connections 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.605+0000 7f8b541b7640 1 -- 172.21.15.83:0/98854472 wait complete. 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 Processor -- start 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 -- start start 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 0x7f8b4c196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 0x7f8b4c1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b4c1025f0 0x7f8b4c19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c10c5a0 con 0x7f8b4c100a40 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c10c420 con 0x7f8b4c1025f0 2024-09-19T09:03:02.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b541b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c10c720 con 0x7f8b4c101c30 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 0x7f8b4c196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 0x7f8b4c196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49926/0 (socket says 172.21.15.83:49926) 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 -- 172.21.15.83:0/1624947643 learned_addr learned my addr 172.21.15.83:0/1624947643 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51752640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 0x7f8b4c1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b52754640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b4c1025f0 0x7f8b4c19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 -- 172.21.15.83:0/1624947643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 msgr2=0x7f8b4c1970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 0x7f8b4c1970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 -- 172.21.15.83:0/1624947643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b4c1025f0 msgr2=0x7f8b4c19e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b4c1025f0 0x7f8b4c19e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 -- 172.21.15.83:0/1624947643 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c19e7b0 con 0x7f8b4c100a40 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51752640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 0x7f8b4c1970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b51f53640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 0x7f8b4c196b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400e9c0 tx=0x7f8b4400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.606+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400cd80 con 0x7f8b4c100a40 2024-09-19T09:03:02.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.607+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4c19eaa0 con 0x7f8b4c100a40 2024-09-19T09:03:02.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.607+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b440035f0 con 0x7f8b4c100a40 2024-09-19T09:03:02.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.607+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44010690 con 0x7f8b4c100a40 2024-09-19T09:03:02.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.607+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b4c19f040 con 0x7f8b4c100a40 2024-09-19T09:03:02.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.607+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4c107d60 con 0x7f8b4c100a40 2024-09-19T09:03:02.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.609+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f8b440037a0 con 0x7f8b4c100a40 2024-09-19T09:03:02.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.609+0000 7f8b4affd640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f8b340a3100 0x7f8b340a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.610+0000 7f8b51752640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f8b340a3100 0x7f8b340a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.610+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f8b440cfe80 con 0x7f8b4c100a40 2024-09-19T09:03:02.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.610+0000 7f8b51752640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f8b340a3100 0x7f8b340a55c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b400058c0 tx=0x7f8b40005850 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.617+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b4409ca30 con 0x7f8b4c100a40 2024-09-19T09:03:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.825+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 --> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f8b4c0626d0 con 0x7f8b340a3100 2024-09-19T09:03:02.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.885+0000 7f8b4affd640 1 -- 172.21.15.83:0/1624947643 <== mgr.15288 v2:172.21.15.83:6800/2671255807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f8b4c0626d0 con 0x7f8b340a3100 2024-09-19T09:03:02.885 INFO:teuthology.orchestra.run.smithi083.stdout:Retention added to path / 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f8b340a3100 msgr2=0x7f8b340a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f8b340a3100 0x7f8b340a55c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b400058c0 tx=0x7f8b40005850 comp rx=0 tx=0).stop 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 msgr2=0x7f8b4c196b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 0x7f8b4c196b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400e9c0 tx=0x7f8b4400ee80 comp rx=0 tx=0).stop 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 shutdown_connections 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b4c1025f0 0x7f8b4c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f8b340a3100 0x7f8b340a55c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b4c101c30 0x7f8b4c1970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 --2- 172.21.15.83:0/1624947643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b4c100a40 0x7f8b4c196b90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 >> 172.21.15.83:0/1624947643 conn(0x7f8b4c0fc1e0 msgr2=0x7f8b4c104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 shutdown_connections 2024-09-19T09:03:02.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:02.889+0000 7f8b541b7640 1 -- 172.21.15.83:0/1624947643 wait complete. 2024-09-19T09:03:02.900 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T09:03:03.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 -- 172.21.15.83:0/2085958579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c100a40 msgr2=0x7fc16c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 --2- 172.21.15.83:0/2085958579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c100a40 0x7fc16c100e40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc154009900 tx=0x7fc15402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 -- 172.21.15.83:0/2085958579 shutdown_connections 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 --2- 172.21.15.83:0/2085958579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c1025f0 0x7fc16c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 --2- 172.21.15.83:0/2085958579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc16c101c30 0x7fc16c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 --2- 172.21.15.83:0/2085958579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c100a40 0x7fc16c100e40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 -- 172.21.15.83:0/2085958579 >> 172.21.15.83:0/2085958579 conn(0x7fc16c0fc1e0 msgr2=0x7fc16c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 -- 172.21.15.83:0/2085958579 shutdown_connections 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.004+0000 7fc17197f640 1 -- 172.21.15.83:0/2085958579 wait complete. 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 Processor -- start 2024-09-19T09:03:03.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 -- start start 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 0x7fc16c06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 0x7fc16c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc16c1025f0 0x7fc16c19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c10c550 con 0x7fc16c101c30 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c10c3d0 con 0x7fc16c100a40 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc17197f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c10c6d0 con 0x7fc16c1025f0 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc16affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 0x7fc16c06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc16a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 0x7fc16c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc16affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 0x7fc16c06a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.83:53234/0 (socket says 172.21.15.83:53234) 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc16a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 0x7fc16c19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49946/0 (socket says 172.21.15.83:49946) 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc16affd640 1 -- 172.21.15.83:0/1844967901 learned_addr learned my addr 172.21.15.83:0/1844967901 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.005+0000 7fc16b7fe640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc16c1025f0 0x7fc16c19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16affd640 1 -- 172.21.15.83:0/1844967901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc16c1025f0 msgr2=0x7fc16c19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16affd640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc16c1025f0 0x7fc16c19f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16affd640 1 -- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 msgr2=0x7fc16c19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16affd640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 0x7fc16c19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16affd640 1 -- 172.21.15.83:0/1844967901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c19f980 con 0x7fc16c100a40 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16a7fc640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 0x7fc16c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc16affd640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 0x7fc16c06a410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1540314e0 tx=0x7fc154031a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15403f030 con 0x7fc16c100a40 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc1540044b0 con 0x7fc16c100a40 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c19fbb0 con 0x7fc16c100a40 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154035070 con 0x7fc16c100a40 2024-09-19T09:03:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.006+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c1a00a0 con 0x7fc16c100a40 2024-09-19T09:03:03.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.007+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16c107e50 con 0x7fc16c100a40 2024-09-19T09:03:03.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.008+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7fc154042030 con 0x7fc16c100a40 2024-09-19T09:03:03.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.009+0000 7fc17097d640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1580a3100 0x7fc1580a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.009+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fc1540efe90 con 0x7fc16c100a40 2024-09-19T09:03:03.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.009+0000 7fc16a7fc640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1580a3100 0x7fc1580a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.009+0000 7fc16a7fc640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1580a3100 0x7fc1580a55c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc16c06a180 tx=0x7fc15c00b390 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.012+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc1540bc3b0 con 0x7fc16c100a40 2024-09-19T09:03:03.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.029+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7fc1540b8a20 con 0x7fc16c100a40 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: [19/Sep/2024:09:03:01] ENGINE Bus STARTING 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: [19/Sep/2024:09:03:01] ENGINE Serving on https://172.21.15.83:7150 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: [19/Sep/2024:09:03:01] ENGINE Error in HTTPServer.serve 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: Traceback (most recent call last): 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._run(expiration_interval) 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:03:03.212 INFO:journalctl@ceph.mon.a.smithi083.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: s = self.context.wrap_socket( 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: return self.sslsocket_class._create( 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: self.do_handshake() 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._sslobj.do_handshake() 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: [19/Sep/2024:09:03:01] ENGINE Serving on http://172.21.15.83:8765 2024-09-19T09:03:03.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: [19/Sep/2024:09:03:01] ENGINE Bus STARTED 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2075610407' entity='client.admin' 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.215 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:03 smithi083 ceph-mon[30926]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T09:03:03.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.217+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 --> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fc16c062630 con 0x7fc1580a3100 2024-09-19T09:03:03.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.224+0000 7fc17097d640 1 -- 172.21.15.83:0/1844967901 <== mgr.15288 v2:172.21.15.83:6800/2671255807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fc16c062630 con 0x7fc1580a3100 2024-09-19T09:03:03.224 INFO:teuthology.orchestra.run.smithi083.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T09:03:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T09:03:03.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1580a3100 msgr2=0x7fc1580a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1580a3100 0x7fc1580a55c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc16c06a180 tx=0x7fc15c00b390 comp rx=0 tx=0).stop 2024-09-19T09:03:03.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 msgr2=0x7fc16c06a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 0x7fc16c06a410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1540314e0 tx=0x7fc154031a30 comp rx=0 tx=0).stop 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 shutdown_connections 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1580a3100 0x7fc1580a55c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc16c1025f0 0x7fc16c19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc16c101c30 0x7fc16c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 --2- 172.21.15.83:0/1844967901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc16c100a40 0x7fc16c06a410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 >> 172.21.15.83:0/1844967901 conn(0x7fc16c0fc1e0 msgr2=0x7fc16c105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 shutdown_connections 2024-09-19T09:03:03.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.226+0000 7fc17197f640 1 -- 172.21.15.83:0/1844967901 wait complete. 2024-09-19T09:03:03.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 -- 172.21.15.83:0/1442264825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0107830 msgr2=0x7f87d0109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 --2- 172.21.15.83:0/1442264825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0107830 0x7f87d0109ca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009ca0 tx=0x7f87c802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 -- 172.21.15.83:0/1442264825 shutdown_connections 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 --2- 172.21.15.83:0/1442264825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0107830 0x7f87d0109ca0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 --2- 172.21.15.83:0/1442264825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d0104f00 0x7f87d01072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 --2- 172.21.15.83:0/1442264825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87d01025d0 0x7f87d01049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 -- 172.21.15.83:0/1442264825 >> 172.21.15.83:0/1442264825 conn(0x7f87d00fc1b0 msgr2=0x7f87d00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 -- 172.21.15.83:0/1442264825 shutdown_connections 2024-09-19T09:03:03.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.368+0000 7f87d5027640 1 -- 172.21.15.83:0/1442264825 wait complete. 2024-09-19T09:03:03.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 Processor -- start 2024-09-19T09:03:03.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 -- start start 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 0x7f87d0101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 0x7f87d0100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87d0107830 0x7f87d0100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87d010d6c0 con 0x7f87d0104f00 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f87d010d540 con 0x7f87d01025d0 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.369+0000 7f87d5027640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f87d010d840 con 0x7f87d0107830 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ce59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 0x7f87d0100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 0x7f87d0101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 0x7f87d0101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.83:53256/0 (socket says 172.21.15.83:53256) 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ce59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 0x7f87d0100580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49956/0 (socket says 172.21.15.83:49956) 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 -- 172.21.15.83:0/2934453125 learned_addr learned my addr 172.21.15.83:0/2934453125 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:03:03.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87cf59e640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87d0107830 0x7f87d0100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 -- 172.21.15.83:0/2934453125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87d0107830 msgr2=0x7f87d0100ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87d0107830 0x7f87d0100ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 -- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 msgr2=0x7f87d0100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 0x7f87d0100580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 -- 172.21.15.83:0/2934453125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d0101350 con 0x7f87d01025d0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ce59c640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 0x7f87d0100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87ced9d640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 0x7f87d0101f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87c000e9f0 tx=0x7f87c000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c000cd80 con 0x7f87d01025d0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87c00054d0 con 0x7f87d01025d0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0010490 con 0x7f87d01025d0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d01a1e30 con 0x7f87d01025d0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.370+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d01a2240 con 0x7f87d01025d0 2024-09-19T09:03:03.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.372+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d00fdca0 con 0x7f87d01025d0 2024-09-19T09:03:03.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.373+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f87c0005020 con 0x7f87d01025d0 2024-09-19T09:03:03.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.373+0000 7f87b7fff640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f87b80a34e0 0x7f87b80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.374+0000 7f87ce59c640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f87b80a34e0 0x7f87b80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.374+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f87c00d0360 con 0x7f87d01025d0 2024-09-19T09:03:03.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.374+0000 7f87ce59c640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f87b80a34e0 0x7f87b80a59a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87d0101cb0 tx=0x7f87c4005f90 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.378+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87c009c9a0 con 0x7f87d01025d0 2024-09-19T09:03:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: [19/Sep/2024:09:03:01] ENGINE Bus STARTING 2024-09-19T09:03:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: [19/Sep/2024:09:03:01] ENGINE Serving on https://172.21.15.83:7150 2024-09-19T09:03:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: [19/Sep/2024:09:03:01] ENGINE Error in HTTPServer.serve 2024-09-19T09:03:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout: Traceback (most recent call last): 2024-09-19T09:03:03.399 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: self._run(expiration_interval) 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: s = self.context.wrap_socket( 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: return self.sslsocket_class._create( 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: self.do_handshake() 2024-09-19T09:03:03.400 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout: self._sslobj.do_handshake() 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: [19/Sep/2024:09:03:01] ENGINE Serving on http://172.21.15.83:8765 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: [19/Sep/2024:09:03:01] ENGINE Bus STARTED 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2075610407' entity='client.admin' 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.403 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:03.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:03 smithi184 ceph-mon[35007]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: [19/Sep/2024:09:03:01] ENGINE Bus STARTING 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: [19/Sep/2024:09:03:01] ENGINE Serving on https://172.21.15.83:7150 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: [19/Sep/2024:09:03:01] ENGINE Error in HTTPServer.serve 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout: Traceback (most recent call last): 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:03:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: self._run(expiration_interval) 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: s = self.context.wrap_socket( 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: return self.sslsocket_class._create( 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: self.do_handshake() 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:03:03.462 INFO:journalctl@ceph.mon.b.smithi122.stdout: self._sslobj.do_handshake() 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: [19/Sep/2024:09:03:01] ENGINE Serving on http://172.21.15.83:8765 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: [19/Sep/2024:09:03:01] ENGINE Bus STARTED 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2075610407' entity='client.admin' 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:03.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:03 smithi122 ceph-mon[34247]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-19T09:03:03.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.614+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 --> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f87d0062630 con 0x7f87b80a34e0 2024-09-19T09:03:03.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.621+0000 7f87b7fff640 1 -- 172.21.15.83:0/2934453125 <== mgr.15288 v2:172.21.15.83:6800/2671255807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f87d0062630 con 0x7f87b80a34e0 2024-09-19T09:03:03.621 INFO:teuthology.orchestra.run.smithi083.stdout:/ 1m 6m3h 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f87b80a34e0 msgr2=0x7f87b80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f87b80a34e0 0x7f87b80a59a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87d0101cb0 tx=0x7f87c4005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 msgr2=0x7f87d0101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 0x7f87d0101f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87c000e9f0 tx=0x7f87c000edf0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 shutdown_connections 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f87b80a34e0 0x7f87b80a59a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87d0107830 0x7f87d0100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87d0104f00 0x7f87d0100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 --2- 172.21.15.83:0/2934453125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87d01025d0 0x7f87d0101f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 >> 172.21.15.83:0/2934453125 conn(0x7f87d00fc1b0 msgr2=0x7f87d0102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 shutdown_connections 2024-09-19T09:03:03.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:03:03.623+0000 7f87d5027640 1 -- 172.21.15.83:0/2934453125 wait complete. 2024-09-19T09:03:03.635 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T09:03:03.661 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T09:03:03.672 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:03:03.713 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:03:03.714 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:03:03.714 INFO:tasks.workunit:timeout=3h 2024-09-19T09:03:03.714 INFO:tasks.workunit:cleanup=True 2024-09-19T09:03:03.714 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-19 09:01:20.711784095 +0000 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-19 09:01:20.711784095 +0000 2024-09-19T09:03:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-19 09:02:59.677135997 +0000 2024-09-19T09:03:03.731 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-09-19T09:03:03.731 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:03.731 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:03:03.803 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:03:03.859 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Unable to set osd_memory_target on smithi122 to 184519372: error parsing value: Value '184519372' is below minimum 939524096 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Unable to set osd_memory_target on smithi083 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Unable to set osd_memory_target on smithi184 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:04.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:04 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Unable to set osd_memory_target on smithi122 to 184519372: error parsing value: Value '184519372' is below minimum 939524096 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Unable to set osd_memory_target on smithi083 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Unable to set osd_memory_target on smithi184 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T09:03:04.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:04.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:04 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.464 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:04.464 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-09-19T09:03:04.464 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Unable to set osd_memory_target on smithi122 to 184519372: error parsing value: Value '184519372' is below minimum 939524096 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Unable to set osd_memory_target on smithi083 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Unable to set osd_memory_target on smithi184 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:04.466 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:04 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:03:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: from='client.24977 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: from='client.24983 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:05 smithi184 ceph-mon[35007]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-19T09:03:05.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: from='client.24977 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: from='client.24983 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:05 smithi122 ceph-mon[34247]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: from='client.24977 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: Updating smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: Updating smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: Updating smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: from='client.24983 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:05 smithi083 ceph-mon[30926]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-19T09:03:06.391 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:06 smithi122 ceph-mon[34247]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:06.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:06 smithi184 ceph-mon[35007]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:06 smithi083 ceph-mon[30926]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:03:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:08 smithi184 ceph-mon[35007]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-09-19T09:03:08.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:08 smithi122 ceph-mon[34247]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-09-19T09:03:08.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:08 smithi083 ceph-mon[30926]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-09-19T09:03:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:10 smithi184 ceph-mon[35007]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-09-19T09:03:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:10 smithi122 ceph-mon[34247]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-09-19T09:03:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:10 smithi083 ceph-mon[30926]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-09-19T09:03:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:12 smithi184 ceph-mon[35007]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-19T09:03:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:12 smithi122 ceph-mon[34247]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-19T09:03:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:12 smithi083 ceph-mon[30926]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-19T09:03:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:14 smithi184 ceph-mon[35007]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T09:03:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:14 smithi122 ceph-mon[34247]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T09:03:14.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:14 smithi083 ceph-mon[30926]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T09:03:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:16 smithi184 ceph-mon[35007]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T09:03:16.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:16 smithi122 ceph-mon[34247]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T09:03:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:16 smithi083 ceph-mon[30926]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T09:03:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:18 smithi184 ceph-mon[35007]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-09-19T09:03:18.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:18 smithi122 ceph-mon[34247]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-09-19T09:03:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:18 smithi083 ceph-mon[30926]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-09-19T09:03:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:20 smithi184 ceph-mon[35007]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T09:03:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:20 smithi122 ceph-mon[34247]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T09:03:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:20 smithi083 ceph-mon[30926]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T09:03:22.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:22 smithi184 ceph-mon[35007]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:03:22.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:22 smithi122 ceph-mon[34247]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:03:22.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:22 smithi083 ceph-mon[30926]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T09:03:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:24 smithi184 ceph-mon[35007]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:03:24.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:24 smithi122 ceph-mon[34247]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:03:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:24 smithi083 ceph-mon[30926]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:03:26.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:26 smithi184 ceph-mon[35007]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:03:26.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:26 smithi122 ceph-mon[34247]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:03:26.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:26 smithi083 ceph-mon[30926]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:03:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:28 smithi184 ceph-mon[35007]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:03:28.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:28 smithi122 ceph-mon[34247]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:03:28.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:28 smithi083 ceph-mon[30926]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T09:03:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:30 smithi184 ceph-mon[35007]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:30.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:30 smithi122 ceph-mon[34247]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:30.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:30 smithi083 ceph-mon[30926]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:32 smithi184 ceph-mon[35007]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:32 smithi122 ceph-mon[34247]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:32 smithi083 ceph-mon[30926]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:34.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:34 smithi184 ceph-mon[35007]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:34 smithi122 ceph-mon[34247]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:34 smithi083 ceph-mon[30926]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:36 smithi184 ceph-mon[35007]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:36 smithi122 ceph-mon[34247]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:36 smithi083 ceph-mon[30926]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:38.408 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:38 smithi184 ceph-mon[35007]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:38.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:38 smithi122 ceph-mon[34247]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:38.467 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:38 smithi083 ceph-mon[30926]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:40 smithi184 ceph-mon[35007]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:40 smithi122 ceph-mon[34247]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:40 smithi083 ceph-mon[30926]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:42.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:42 smithi184 ceph-mon[35007]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:42 smithi122 ceph-mon[34247]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:42.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:42 smithi083 ceph-mon[30926]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:44 smithi184 ceph-mon[35007]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:44.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:44 smithi122 ceph-mon[34247]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:44.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:44 smithi083 ceph-mon[30926]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:46 smithi184 ceph-mon[35007]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:46 smithi122 ceph-mon[34247]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:46.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:46 smithi083 ceph-mon[30926]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:48.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:48 smithi184 ceph-mon[35007]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:48 smithi122 ceph-mon[34247]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:48.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:48 smithi083 ceph-mon[30926]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:50 smithi184 ceph-mon[35007]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:50.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:50 smithi122 ceph-mon[34247]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:50.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:50 smithi083 ceph-mon[30926]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:52.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:52 smithi184 ceph-mon[35007]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:52.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:52 smithi122 ceph-mon[34247]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:52.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:52 smithi083 ceph-mon[30926]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:54.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:54 smithi184 ceph-mon[35007]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:54.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:54 smithi122 ceph-mon[34247]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:54 smithi083 ceph-mon[30926]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:56 smithi184 ceph-mon[35007]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:56.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:56 smithi122 ceph-mon[34247]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:56.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:56 smithi083 ceph-mon[30926]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:03:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:03:58 smithi184 ceph-mon[35007]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:58.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:03:58 smithi122 ceph-mon[34247]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:03:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:03:58 smithi083 ceph-mon[30926]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T09:04:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:00 smithi184 ceph-mon[35007]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:04:00.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:00 smithi122 ceph-mon[34247]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:04:00.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:00 smithi083 ceph-mon[30926]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:04:01.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:04:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:04:00.893+0000 7f3611776640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:04:01.211 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:04:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:04:00.893+0000 7f3611776640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:04:01.212 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:04:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:04:00.893+0000 7f3611776640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:04:01.212 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:04:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:04:00.893+0000 7f3611776640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:04:01.212 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:04:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:04:00.893+0000 7f3611776640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:04:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:02 smithi184 ceph-mon[35007]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-19T09:04:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:02 smithi184 ceph-mon[35007]: mgrmap e25: x(active, since 62s), standbys: y, z 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:04:02.429 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-19T09:04:02.430 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:04:02.435 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:04:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:02 smithi122 ceph-mon[34247]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-19T09:04:02.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:02 smithi122 ceph-mon[34247]: mgrmap e25: x(active, since 62s), standbys: y, z 2024-09-19T09:04:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:02 smithi083 ceph-mon[30926]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-19T09:04:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:02 smithi083 ceph-mon[30926]: mgrmap e25: x(active, since 62s), standbys: y, z 2024-09-19T09:04:02.489 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:04:02.491 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:04:02.491 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:04:03.233 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:04:03.312 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:04:03.354 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:04:03.355 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:04:03.355 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:04:03.394 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:04:03.398 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:04:03.398 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:04:03.454 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-19T09:04:03.456 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-19T09:04:03.457 DEBUG:teuthology.orchestra.run.smithi083:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T09:04:03.520 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T09:04:03.521 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-19T09:04:03.521 INFO:tasks.workunit.client.0.smithi083.stderr:+ trap -- retry EXIT 2024-09-19T09:04:03.521 INFO:tasks.workunit.client.0.smithi083.stderr:+ rm -rf ffsb 2024-09-19T09:04:03.521 INFO:tasks.workunit.client.0.smithi083.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-19T09:04:03.525 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into 'ffsb'... 2024-09-19T09:04:04.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:04 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:04.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:04 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:04.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:04 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:05.256 INFO:tasks.workunit.client.0.smithi083.stderr:+ trap - EXIT 2024-09-19T09:04:05.256 INFO:tasks.workunit.client.0.smithi083.stderr:+ cd ffsb 2024-09-19T09:04:05.257 INFO:tasks.workunit.client.0.smithi083.stderr:+ ./configure 2024-09-19T09:04:05.375 INFO:tasks.workunit.client.0.smithi083.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T09:04:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T09:04:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:05.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:04:06.386 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether build environment is sane... yes 2024-09-19T09:04:06.401 INFO:tasks.workunit.client.0.smithi083.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T09:04:06.402 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gawk... gawk 2024-09-19T09:04:06.426 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T09:04:06.468 INFO:tasks.workunit.client.0.smithi083.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T09:04:06.468 INFO:tasks.workunit.client.0.smithi083.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T09:04:06.486 INFO:tasks.workunit.client.0.smithi083.stdout:checking for style of include used by make... GNU 2024-09-19T09:04:06.491 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc... gcc 2024-09-19T09:04:06.571 INFO:tasks.workunit.client.0.smithi083.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:04:06.573 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether the C compiler works... yes 2024-09-19T09:04:06.577 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether we are cross compiling... no 2024-09-19T09:04:06.626 INFO:tasks.workunit.client.0.smithi083.stdout:checking for suffix of executables... 2024-09-19T09:04:06.668 INFO:tasks.workunit.client.0.smithi083.stdout:checking for suffix of object files... o 2024-09-19T09:04:06.714 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:04:06.756 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:04:06.830 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:04:06.982 INFO:tasks.workunit.client.0.smithi083.stdout:checking dependency style of gcc... gcc3 2024-09-19T09:04:07.050 INFO:tasks.workunit.client.0.smithi083.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:04:07.110 INFO:tasks.workunit.client.0.smithi083.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:04:07.112 INFO:tasks.workunit.client.0.smithi083.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:04:07.125 INFO:tasks.workunit.client.0.smithi083.stdout:checking for AIX... no 2024-09-19T09:04:07.162 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc... (cached) gcc 2024-09-19T09:04:07.174 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:04:07.175 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:04:07.176 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:04:07.176 INFO:tasks.workunit.client.0.smithi083.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T09:04:07.246 INFO:tasks.workunit.client.0.smithi083.stdout:checking for main in -lm... yes 2024-09-19T09:04:07.321 INFO:tasks.workunit.client.0.smithi083.stdout:checking for main in -lpthread... yes 2024-09-19T09:04:07.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:07 smithi184 ceph-mon[35007]: pgmap v36: 129 pgs: 129 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-19T09:04:07.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:07 smithi122 ceph-mon[34247]: pgmap v36: 129 pgs: 129 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-19T09:04:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:07 smithi083 ceph-mon[30926]: pgmap v36: 129 pgs: 129 active+clean; 1.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-19T09:04:07.520 INFO:tasks.workunit.client.0.smithi083.stdout:checking for ANSI C header files... yes 2024-09-19T09:04:07.601 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T09:04:07.660 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/types.h... yes 2024-09-19T09:04:07.722 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/stat.h... yes 2024-09-19T09:04:07.782 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stdlib.h... yes 2024-09-19T09:04:07.844 INFO:tasks.workunit.client.0.smithi083.stdout:checking for string.h... yes 2024-09-19T09:04:07.909 INFO:tasks.workunit.client.0.smithi083.stdout:checking for memory.h... yes 2024-09-19T09:04:07.977 INFO:tasks.workunit.client.0.smithi083.stdout:checking for strings.h... yes 2024-09-19T09:04:08.041 INFO:tasks.workunit.client.0.smithi083.stdout:checking for inttypes.h... yes 2024-09-19T09:04:08.107 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stdint.h... yes 2024-09-19T09:04:08.181 INFO:tasks.workunit.client.0.smithi083.stdout:checking for unistd.h... yes 2024-09-19T09:04:08.255 INFO:tasks.workunit.client.0.smithi083.stdout:checking pthread.h usability... yes 2024-09-19T09:04:08.283 INFO:tasks.workunit.client.0.smithi083.stdout:checking pthread.h presence... yes 2024-09-19T09:04:08.284 INFO:tasks.workunit.client.0.smithi083.stdout:checking for pthread.h... yes 2024-09-19T09:04:08.351 INFO:tasks.workunit.client.0.smithi083.stdout:checking fcntl.h usability... yes 2024-09-19T09:04:08.379 INFO:tasks.workunit.client.0.smithi083.stdout:checking fcntl.h presence... yes 2024-09-19T09:04:08.380 INFO:tasks.workunit.client.0.smithi083.stdout:checking for fcntl.h... yes 2024-09-19T09:04:08.449 INFO:tasks.workunit.client.0.smithi083.stdout:checking limits.h usability... yes 2024-09-19T09:04:08.476 INFO:tasks.workunit.client.0.smithi083.stdout:checking limits.h presence... yes 2024-09-19T09:04:08.477 INFO:tasks.workunit.client.0.smithi083.stdout:checking for limits.h... yes 2024-09-19T09:04:08.499 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stdint.h... (cached) yes 2024-09-19T09:04:08.576 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/time.h usability... yes 2024-09-19T09:04:08.604 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/time.h presence... yes 2024-09-19T09:04:08.605 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/time.h... yes 2024-09-19T09:04:08.626 INFO:tasks.workunit.client.0.smithi083.stdout:checking for unistd.h... (cached) yes 2024-09-19T09:04:08.684 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/vfs.h usability... yes 2024-09-19T09:04:08.714 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/vfs.h presence... yes 2024-09-19T09:04:08.714 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/vfs.h... yes 2024-09-19T09:04:08.781 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/limits.h usability... no 2024-09-19T09:04:08.810 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/limits.h presence... no 2024-09-19T09:04:08.810 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/limits.h... no 2024-09-19T09:04:08.854 INFO:tasks.workunit.client.0.smithi083.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T09:04:08.902 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T09:04:08.905 INFO:tasks.workunit.client.0.smithi083.stdout:checking for function prototypes... yes 2024-09-19T09:04:08.967 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether setvbuf arguments are reversed... no 2024-09-19T09:04:09.049 INFO:tasks.workunit.client.0.smithi083.stdout:checking for system... yes 2024-09-19T09:04:09.135 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gettimeofday... yes 2024-09-19T09:04:09.241 INFO:tasks.workunit.client.0.smithi083.stdout:checking for mkdir... yes 2024-09-19T09:04:09.331 INFO:tasks.workunit.client.0.smithi083.stdout:checking for strerror... yes 2024-09-19T09:04:09.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:09 smithi184 ceph-mon[35007]: pgmap v37: 129 pgs: 129 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 247 KiB/s wr, 56 op/s 2024-09-19T09:04:09.417 INFO:tasks.workunit.client.0.smithi083.stdout:checking for open64... yes 2024-09-19T09:04:09.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:09 smithi122 ceph-mon[34247]: pgmap v37: 129 pgs: 129 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 247 KiB/s wr, 56 op/s 2024-09-19T09:04:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:09 smithi083 ceph-mon[30926]: pgmap v37: 129 pgs: 129 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 247 KiB/s wr, 56 op/s 2024-09-19T09:04:09.505 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stat64... yes 2024-09-19T09:04:09.588 INFO:tasks.workunit.client.0.smithi083.stdout:checking for fseeko64... yes 2024-09-19T09:04:09.672 INFO:tasks.workunit.client.0.smithi083.stdout:checking for lrand48_r... yes 2024-09-19T09:04:09.760 INFO:tasks.workunit.client.0.smithi083.stdout:checking for srand48_r... yes 2024-09-19T09:04:09.787 INFO:tasks.workunit.client.0.smithi083.stdout:configure: creating ./config.status 2024-09-19T09:04:09.913 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: creating Makefile 2024-09-19T09:04:09.931 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: creating config.h 2024-09-19T09:04:09.956 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: executing depfiles commands 2024-09-19T09:04:10.030 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: executing default commands 2024-09-19T09:04:10.120 INFO:tasks.workunit.client.0.smithi083.stderr:+ make 2024-09-19T09:04:10.160 INFO:tasks.workunit.client.0.smithi083.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-19T09:04:10.172 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-19T09:04:10.176 INFO:tasks.workunit.client.0.smithi083.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-19T09:04:10.176 INFO:tasks.workunit.client.0.smithi083.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-19T09:04:10.176 INFO:tasks.workunit.client.0.smithi083.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-19T09:04:10.176 INFO:tasks.workunit.client.0.smithi083.stderr: any GNU archive site. 2024-09-19T09:04:10.184 INFO:tasks.workunit.client.0.smithi083.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-19T09:04:10.193 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-19T09:04:10.194 INFO:tasks.workunit.client.0.smithi083.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-19T09:04:10.194 INFO:tasks.workunit.client.0.smithi083.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-19T09:04:10.194 INFO:tasks.workunit.client.0.smithi083.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-19T09:04:10.195 INFO:tasks.workunit.client.0.smithi083.stderr: Grab them from any GNU archive site. 2024-09-19T09:04:10.390 INFO:tasks.workunit.client.0.smithi083.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-19T09:04:10.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:10 smithi184 ceph-mon[35007]: pgmap v38: 129 pgs: 129 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 247 KiB/s wr, 51 op/s 2024-09-19T09:04:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:10 smithi122 ceph-mon[34247]: pgmap v38: 129 pgs: 129 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 247 KiB/s wr, 51 op/s 2024-09-19T09:04:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:10 smithi083 ceph-mon[30926]: pgmap v38: 129 pgs: 129 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 247 KiB/s wr, 51 op/s 2024-09-19T09:04:10.722 INFO:tasks.workunit.client.0.smithi083.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-19T09:04:10.722 INFO:tasks.workunit.client.0.smithi083.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-19T09:04:10.723 INFO:tasks.workunit.client.0.smithi083.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-19T09:04:10.723 INFO:tasks.workunit.client.0.smithi083.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-19T09:04:10.852 INFO:tasks.workunit.client.0.smithi083.stdout:/bin/sh ./config.status --recheck 2024-09-19T09:04:10.914 INFO:tasks.workunit.client.0.smithi083.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-19T09:04:11.068 INFO:tasks.workunit.client.0.smithi083.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T09:04:12.080 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether build environment is sane... yes 2024-09-19T09:04:12.091 INFO:tasks.workunit.client.0.smithi083.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T09:04:12.092 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gawk... gawk 2024-09-19T09:04:12.128 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T09:04:12.178 INFO:tasks.workunit.client.0.smithi083.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T09:04:12.178 INFO:tasks.workunit.client.0.smithi083.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T09:04:12.198 INFO:tasks.workunit.client.0.smithi083.stdout:checking for style of include used by make... GNU 2024-09-19T09:04:12.204 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc... gcc 2024-09-19T09:04:12.354 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether the C compiler works... yes 2024-09-19T09:04:12.354 INFO:tasks.workunit.client.0.smithi083.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:04:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:12 smithi184 ceph-mon[35007]: pgmap v39: 129 pgs: 129 active+clean; 6.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 579 KiB/s wr, 121 op/s 2024-09-19T09:04:12.407 INFO:tasks.workunit.client.0.smithi083.stdout:checking for suffix of executables... 2024-09-19T09:04:12.459 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether we are cross compiling... no 2024-09-19T09:04:12.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:12 smithi122 ceph-mon[34247]: pgmap v39: 129 pgs: 129 active+clean; 6.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 579 KiB/s wr, 121 op/s 2024-09-19T09:04:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:12 smithi083 ceph-mon[30926]: pgmap v39: 129 pgs: 129 active+clean; 6.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 579 KiB/s wr, 121 op/s 2024-09-19T09:04:12.513 INFO:tasks.workunit.client.0.smithi083.stdout:checking for suffix of object files... o 2024-09-19T09:04:12.545 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:04:12.578 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:04:12.621 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:04:12.767 INFO:tasks.workunit.client.0.smithi083.stdout:checking dependency style of gcc... gcc3 2024-09-19T09:04:12.835 INFO:tasks.workunit.client.0.smithi083.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:04:12.899 INFO:tasks.workunit.client.0.smithi083.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:04:12.900 INFO:tasks.workunit.client.0.smithi083.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:04:13.063 INFO:tasks.workunit.client.0.smithi083.stdout:checking for ANSI C header files... yes 2024-09-19T09:04:13.113 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/types.h... yes 2024-09-19T09:04:13.165 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/stat.h... yes 2024-09-19T09:04:13.217 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stdlib.h... yes 2024-09-19T09:04:13.271 INFO:tasks.workunit.client.0.smithi083.stdout:checking for string.h... yes 2024-09-19T09:04:13.327 INFO:tasks.workunit.client.0.smithi083.stdout:checking for memory.h... yes 2024-09-19T09:04:13.379 INFO:tasks.workunit.client.0.smithi083.stdout:checking for strings.h... yes 2024-09-19T09:04:13.433 INFO:tasks.workunit.client.0.smithi083.stdout:checking for inttypes.h... yes 2024-09-19T09:04:13.491 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stdint.h... yes 2024-09-19T09:04:13.547 INFO:tasks.workunit.client.0.smithi083.stdout:checking for unistd.h... yes 2024-09-19T09:04:13.608 INFO:tasks.workunit.client.0.smithi083.stdout:checking minix/config.h usability... no 2024-09-19T09:04:13.647 INFO:tasks.workunit.client.0.smithi083.stdout:checking minix/config.h presence... no 2024-09-19T09:04:13.647 INFO:tasks.workunit.client.0.smithi083.stdout:checking for minix/config.h... no 2024-09-19T09:04:13.690 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-19T09:04:13.699 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc... (cached) gcc 2024-09-19T09:04:13.749 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:04:13.749 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:04:13.749 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:04:13.750 INFO:tasks.workunit.client.0.smithi083.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T09:04:13.808 INFO:tasks.workunit.client.0.smithi083.stdout:checking for main in -lm... yes 2024-09-19T09:04:13.871 INFO:tasks.workunit.client.0.smithi083.stdout:checking for main in -lpthread... yes 2024-09-19T09:04:13.877 INFO:tasks.workunit.client.0.smithi083.stdout:checking for ANSI C header files... (cached) yes 2024-09-19T09:04:13.917 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T09:04:13.977 INFO:tasks.workunit.client.0.smithi083.stdout:checking pthread.h usability... yes 2024-09-19T09:04:14.002 INFO:tasks.workunit.client.0.smithi083.stdout:checking pthread.h presence... yes 2024-09-19T09:04:14.002 INFO:tasks.workunit.client.0.smithi083.stdout:checking for pthread.h... yes 2024-09-19T09:04:14.062 INFO:tasks.workunit.client.0.smithi083.stdout:checking fcntl.h usability... yes 2024-09-19T09:04:14.086 INFO:tasks.workunit.client.0.smithi083.stdout:checking fcntl.h presence... yes 2024-09-19T09:04:14.086 INFO:tasks.workunit.client.0.smithi083.stdout:checking for fcntl.h... yes 2024-09-19T09:04:14.151 INFO:tasks.workunit.client.0.smithi083.stdout:checking limits.h usability... yes 2024-09-19T09:04:14.176 INFO:tasks.workunit.client.0.smithi083.stdout:checking limits.h presence... yes 2024-09-19T09:04:14.177 INFO:tasks.workunit.client.0.smithi083.stdout:checking for limits.h... yes 2024-09-19T09:04:14.217 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stdint.h... (cached) yes 2024-09-19T09:04:14.269 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/time.h usability... yes 2024-09-19T09:04:14.292 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/time.h presence... yes 2024-09-19T09:04:14.292 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/time.h... yes 2024-09-19T09:04:14.312 INFO:tasks.workunit.client.0.smithi083.stdout:checking for unistd.h... (cached) yes 2024-09-19T09:04:14.364 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/vfs.h usability... yes 2024-09-19T09:04:14.387 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/vfs.h presence... yes 2024-09-19T09:04:14.387 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/vfs.h... yes 2024-09-19T09:04:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:14 smithi184 ceph-mon[35007]: pgmap v40: 129 pgs: 129 active+clean; 6.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 557 KiB/s wr, 101 op/s 2024-09-19T09:04:14.456 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/limits.h usability... no 2024-09-19T09:04:14.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:14 smithi122 ceph-mon[34247]: pgmap v40: 129 pgs: 129 active+clean; 6.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 557 KiB/s wr, 101 op/s 2024-09-19T09:04:14.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:14 smithi083 ceph-mon[30926]: pgmap v40: 129 pgs: 129 active+clean; 6.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 557 KiB/s wr, 101 op/s 2024-09-19T09:04:14.497 INFO:tasks.workunit.client.0.smithi083.stdout:checking sys/limits.h presence... no 2024-09-19T09:04:14.498 INFO:tasks.workunit.client.0.smithi083.stdout:checking for sys/limits.h... no 2024-09-19T09:04:14.531 INFO:tasks.workunit.client.0.smithi083.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T09:04:14.566 INFO:tasks.workunit.client.0.smithi083.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T09:04:14.652 INFO:tasks.workunit.client.0.smithi083.stdout:checking for system... yes 2024-09-19T09:04:14.733 INFO:tasks.workunit.client.0.smithi083.stdout:checking for gettimeofday... yes 2024-09-19T09:04:14.806 INFO:tasks.workunit.client.0.smithi083.stdout:checking for mkdir... yes 2024-09-19T09:04:14.931 INFO:tasks.workunit.client.0.smithi083.stdout:checking for strerror... yes 2024-09-19T09:04:15.009 INFO:tasks.workunit.client.0.smithi083.stdout:checking for open64... yes 2024-09-19T09:04:15.088 INFO:tasks.workunit.client.0.smithi083.stdout:checking for stat64... yes 2024-09-19T09:04:15.165 INFO:tasks.workunit.client.0.smithi083.stdout:checking for fseeko64... yes 2024-09-19T09:04:15.262 INFO:tasks.workunit.client.0.smithi083.stdout:checking for lrand48_r... yes 2024-09-19T09:04:15.341 INFO:tasks.workunit.client.0.smithi083.stdout:checking for srand48_r... yes 2024-09-19T09:04:15.367 INFO:tasks.workunit.client.0.smithi083.stdout:configure: creating ./config.status 2024-09-19T09:04:15.468 INFO:tasks.workunit.client.0.smithi083.stdout: /bin/sh ./config.status 2024-09-19T09:04:15.530 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: creating Makefile 2024-09-19T09:04:15.546 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: creating config.h 2024-09-19T09:04:15.573 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: executing depfiles commands 2024-09-19T09:04:15.591 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: executing default commands 2024-09-19T09:04:15.647 INFO:tasks.workunit.client.0.smithi083.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-19T09:04:15.804 INFO:tasks.workunit.client.0.smithi083.stdout:rm -f stamp-h1 2024-09-19T09:04:15.808 INFO:tasks.workunit.client.0.smithi083.stdout:touch config.h.in 2024-09-19T09:04:15.809 INFO:tasks.workunit.client.0.smithi083.stdout:cd . && /bin/sh ./config.status config.h 2024-09-19T09:04:15.866 INFO:tasks.workunit.client.0.smithi083.stdout:config.status: creating config.h 2024-09-19T09:04:15.901 INFO:tasks.workunit.client.0.smithi083.stdout:make all-am 2024-09-19T09:04:15.926 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T09:04:15.926 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-19T09:04:16.103 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-19T09:04:16.113 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-19T09:04:16.234 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-19T09:04:16.244 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-19T09:04:16.351 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-19T09:04:16.362 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-19T09:04:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:16 smithi184 ceph-mon[35007]: pgmap v41: 129 pgs: 129 active+clean; 9.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 817 KiB/s wr, 155 op/s 2024-09-19T09:04:16.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:16 smithi122 ceph-mon[34247]: pgmap v41: 129 pgs: 129 active+clean; 9.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 817 KiB/s wr, 155 op/s 2024-09-19T09:04:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:16 smithi083 ceph-mon[30926]: pgmap v41: 129 pgs: 129 active+clean; 9.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 817 KiB/s wr, 155 op/s 2024-09-19T09:04:16.476 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-19T09:04:16.485 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-19T09:04:16.654 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-19T09:04:16.664 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-19T09:04:16.736 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-19T09:04:16.745 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-19T09:04:16.801 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-19T09:04:16.812 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-19T09:04:16.878 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-19T09:04:16.887 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-19T09:04:17.102 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-19T09:04:17.112 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-19T09:04:17.266 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-19T09:04:17.277 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-19T09:04:17.465 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-19T09:04:17.476 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-19T09:04:17.562 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-19T09:04:17.621 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-19T09:04:17.722 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-19T09:04:17.732 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-19T09:04:17.866 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-19T09:04:17.880 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-19T09:04:17.923 INFO:tasks.workunit.client.0.smithi083.stderr:In file included from parser.h:22, 2024-09-19T09:04:17.924 INFO:tasks.workunit.client.0.smithi083.stderr: from parser.c:25: 2024-09-19T09:04:17.924 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c: In function ‘init_filesys’: 2024-09-19T09:04:17.925 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.925 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.925 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.926 INFO:tasks.workunit.client.0.smithi083.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.927 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.928 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T09:04:17.929 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.930 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.931 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.932 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.933 INFO:tasks.workunit.client.0.smithi083.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.934 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: | ^ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:04:17.935 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~ 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~ 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T09:04:17.936 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c: In function ‘get_optstr’: 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:200:14: note: source object declared here 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr: 200 | char temp[BUFSIZE]; 2024-09-19T09:04:17.980 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~ 2024-09-19T09:04:17.987 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c: In function ‘size64_convert’: 2024-09-19T09:04:17.987 INFO:tasks.workunit.client.0.smithi083.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-19T09:04:17.987 INFO:tasks.workunit.client.0.smithi083.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-19T09:04:17.988 INFO:tasks.workunit.client.0.smithi083.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-19T09:04:18.291 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-19T09:04:18.307 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-19T09:04:18.392 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-19T09:04:18.405 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-19T09:04:18.517 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-19T09:04:18.531 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-19T09:04:18.577 INFO:tasks.workunit.client.0.smithi083.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-19T09:04:18.589 INFO:tasks.workunit.client.0.smithi083.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-19T09:04:18.683 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T09:04:18.684 INFO:tasks.workunit.client.0.smithi083.stderr:+ cd .. 2024-09-19T09:04:18.685 INFO:tasks.workunit.client.0.smithi083.stderr:+ mkdir tmp 2024-09-19T09:04:18.688 INFO:tasks.workunit.client.0.smithi083.stderr:+ cd tmp 2024-09-19T09:04:18.689 INFO:tasks.workunit.client.0.smithi083.stderr:+ for f in $mydir/*.ffsb 2024-09-19T09:04:18.689 INFO:tasks.workunit.client.0.smithi083.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-19T09:04:18.690 INFO:tasks.workunit.client.0.smithi083.stdout:FFSB version 6.0-RC2 started 2024-09-19T09:04:18.690 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout:benchmark time = 300 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout:ThreadGroup 0 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout:================ 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout: num_threads = 32 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout: read_random = off 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout: read_size = 0 (0B) 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout: read_blocksize = 0 (0B) 2024-09-19T09:04:18.693 INFO:tasks.workunit.client.0.smithi083.stdout: read_skip = off 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: read_skipsize = 0 (0B) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: write_random = on 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: write_size = 5242880 (5MB) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: fsync_file = 0 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: write_blocksize = 4096 (4KB) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: wait time = 0 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: op weights 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: read = 0 (0.00%) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: readall = 0 (0.00%) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: write = 1 (100.00%) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: create = 0 (0.00%) 2024-09-19T09:04:18.694 INFO:tasks.workunit.client.0.smithi083.stdout: append = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: delete = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: metaop = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: createdir = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: stat = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: writeall = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: writeall_fsync = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: open_close = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: write_fsync = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: create_fsync = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: append_fsync = 0 (0.00%) 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout:FileSystem . 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout:========== 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: num_dirs = 0 2024-09-19T09:04:18.695 INFO:tasks.workunit.client.0.smithi083.stdout: starting files = 128 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: min file size = 104857600 (100MB) 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: max file size = 104857600 (100MB) 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: directio = off 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: alignedio = on 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: bufferedio = off 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: aging is off 2024-09-19T09:04:18.696 INFO:tasks.workunit.client.0.smithi083.stdout: current utilization = 0.04% 2024-09-19T09:04:18.697 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:04:18.697 INFO:tasks.workunit.client.0.smithi083.stdout:checking existing fs: . 2024-09-19T09:04:18.697 INFO:tasks.workunit.client.0.smithi083.stdout:recreating new fileset 2024-09-19T09:04:18.697 INFO:tasks.workunit.client.0.smithi083.stderr:opendir: No such file or directory 2024-09-19T09:04:18.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:18 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:18.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:18 smithi184 ceph-mon[35007]: pgmap v42: 129 pgs: 129 active+clean; 9.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 815 KiB/s wr, 165 op/s 2024-09-19T09:04:18.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:18 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:18.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:18 smithi122 ceph-mon[34247]: pgmap v42: 129 pgs: 129 active+clean; 9.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 815 KiB/s wr, 165 op/s 2024-09-19T09:04:18.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:18 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:18.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:18 smithi083 ceph-mon[30926]: pgmap v42: 129 pgs: 129 active+clean; 9.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 815 KiB/s wr, 165 op/s 2024-09-19T09:04:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:20 smithi184 ceph-mon[35007]: pgmap v43: 129 pgs: 129 active+clean; 9.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 607 KiB/s wr, 137 op/s 2024-09-19T09:04:20.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:20 smithi122 ceph-mon[34247]: pgmap v43: 129 pgs: 129 active+clean; 9.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 607 KiB/s wr, 137 op/s 2024-09-19T09:04:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:20 smithi083 ceph-mon[30926]: pgmap v43: 129 pgs: 129 active+clean; 9.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 607 KiB/s wr, 137 op/s 2024-09-19T09:04:22.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:22 smithi184 ceph-mon[35007]: pgmap v44: 129 pgs: 129 active+clean; 79 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 6.4 MiB/s wr, 169 op/s 2024-09-19T09:04:22.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:22 smithi122 ceph-mon[34247]: pgmap v44: 129 pgs: 129 active+clean; 79 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 6.4 MiB/s wr, 169 op/s 2024-09-19T09:04:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:22 smithi083 ceph-mon[30926]: pgmap v44: 129 pgs: 129 active+clean; 79 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 6.4 MiB/s wr, 169 op/s 2024-09-19T09:04:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:24 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:24.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:24 smithi184 ceph-mon[35007]: pgmap v45: 129 pgs: 129 active+clean; 79 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 6.1 MiB/s wr, 100 op/s 2024-09-19T09:04:24.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:24 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:24.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:24 smithi122 ceph-mon[34247]: pgmap v45: 129 pgs: 129 active+clean; 79 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 6.1 MiB/s wr, 100 op/s 2024-09-19T09:04:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:24 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:24 smithi083 ceph-mon[30926]: pgmap v45: 129 pgs: 129 active+clean; 79 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 6.1 MiB/s wr, 100 op/s 2024-09-19T09:04:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:26 smithi184 ceph-mon[35007]: pgmap v46: 129 pgs: 129 active+clean; 203 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 16 MiB/s wr, 110 op/s 2024-09-19T09:04:26.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:26 smithi122 ceph-mon[34247]: pgmap v46: 129 pgs: 129 active+clean; 203 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 16 MiB/s wr, 110 op/s 2024-09-19T09:04:26.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:26 smithi083 ceph-mon[30926]: pgmap v46: 129 pgs: 129 active+clean; 203 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 16 MiB/s wr, 110 op/s 2024-09-19T09:04:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:28 smithi184 ceph-mon[35007]: pgmap v47: 129 pgs: 129 active+clean; 231 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 19 MiB/s wr, 57 op/s 2024-09-19T09:04:28.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:28 smithi122 ceph-mon[34247]: pgmap v47: 129 pgs: 129 active+clean; 231 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 19 MiB/s wr, 57 op/s 2024-09-19T09:04:28.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:28 smithi083 ceph-mon[30926]: pgmap v47: 129 pgs: 129 active+clean; 231 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 19 MiB/s wr, 57 op/s 2024-09-19T09:04:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:30 smithi184 ceph-mon[35007]: pgmap v48: 129 pgs: 129 active+clean; 231 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 19 MiB/s wr, 44 op/s 2024-09-19T09:04:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:30 smithi122 ceph-mon[34247]: pgmap v48: 129 pgs: 129 active+clean; 231 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 19 MiB/s wr, 44 op/s 2024-09-19T09:04:30.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:30 smithi083 ceph-mon[30926]: pgmap v48: 129 pgs: 129 active+clean; 231 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 19 MiB/s wr, 44 op/s 2024-09-19T09:04:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:32 smithi184 ceph-mon[35007]: pgmap v49: 129 pgs: 129 active+clean; 387 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 32 MiB/s wr, 55 op/s 2024-09-19T09:04:32.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:32 smithi184 ceph-mon[35007]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T09:04:32.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:32 smithi122 ceph-mon[34247]: pgmap v49: 129 pgs: 129 active+clean; 387 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 32 MiB/s wr, 55 op/s 2024-09-19T09:04:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:32 smithi122 ceph-mon[34247]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T09:04:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:32 smithi083 ceph-mon[30926]: pgmap v49: 129 pgs: 129 active+clean; 387 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 32 MiB/s wr, 55 op/s 2024-09-19T09:04:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:32 smithi083 ceph-mon[30926]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-19T09:04:34.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:34 smithi184 ceph-mon[35007]: pgmap v50: 129 pgs: 129 active+clean; 387 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-19T09:04:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:34 smithi122 ceph-mon[34247]: pgmap v50: 129 pgs: 129 active+clean; 387 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-19T09:04:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:34 smithi083 ceph-mon[30926]: pgmap v50: 129 pgs: 129 active+clean; 387 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-19T09:04:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:36 smithi184 ceph-mon[35007]: pgmap v51: 129 pgs: 129 active+clean; 519 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 MiB/s wr, 32 op/s 2024-09-19T09:04:36.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:36 smithi122 ceph-mon[34247]: pgmap v51: 129 pgs: 129 active+clean; 519 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 MiB/s wr, 32 op/s 2024-09-19T09:04:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:36 smithi083 ceph-mon[30926]: pgmap v51: 129 pgs: 129 active+clean; 519 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 MiB/s wr, 32 op/s 2024-09-19T09:04:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:38 smithi184 ceph-mon[35007]: pgmap v52: 129 pgs: 129 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-19T09:04:38.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:38 smithi122 ceph-mon[34247]: pgmap v52: 129 pgs: 129 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-19T09:04:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:38 smithi083 ceph-mon[30926]: pgmap v52: 129 pgs: 129 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 23 op/s 2024-09-19T09:04:40.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:40 smithi184 ceph-mon[35007]: pgmap v53: 129 pgs: 129 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-19T09:04:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:40 smithi122 ceph-mon[34247]: pgmap v53: 129 pgs: 129 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-19T09:04:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:40 smithi083 ceph-mon[30926]: pgmap v53: 129 pgs: 129 active+clean; 543 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 22 op/s 2024-09-19T09:04:42.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:42 smithi184 ceph-mon[35007]: pgmap v54: 129 pgs: 129 active+clean; 699 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 31 op/s 2024-09-19T09:04:42.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:42 smithi122 ceph-mon[34247]: pgmap v54: 129 pgs: 129 active+clean; 699 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 31 op/s 2024-09-19T09:04:42.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:42 smithi083 ceph-mon[30926]: pgmap v54: 129 pgs: 129 active+clean; 699 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 31 op/s 2024-09-19T09:04:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:44 smithi184 ceph-mon[35007]: pgmap v55: 129 pgs: 129 active+clean; 699 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 20 op/s 2024-09-19T09:04:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:44 smithi122 ceph-mon[34247]: pgmap v55: 129 pgs: 129 active+clean; 699 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 20 op/s 2024-09-19T09:04:44.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:44 smithi083 ceph-mon[30926]: pgmap v55: 129 pgs: 129 active+clean; 699 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 20 op/s 2024-09-19T09:04:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:46 smithi184 ceph-mon[35007]: pgmap v56: 129 pgs: 129 active+clean; 835 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 37 MiB/s wr, 29 op/s 2024-09-19T09:04:46.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:46 smithi122 ceph-mon[34247]: pgmap v56: 129 pgs: 129 active+clean; 835 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 37 MiB/s wr, 29 op/s 2024-09-19T09:04:46.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:46 smithi083 ceph-mon[30926]: pgmap v56: 129 pgs: 129 active+clean; 835 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 37 MiB/s wr, 29 op/s 2024-09-19T09:04:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:48 smithi184 ceph-mon[35007]: pgmap v57: 129 pgs: 129 active+clean; 855 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 20 op/s 2024-09-19T09:04:48.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:48 smithi122 ceph-mon[34247]: pgmap v57: 129 pgs: 129 active+clean; 855 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 20 op/s 2024-09-19T09:04:48.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:48 smithi083 ceph-mon[30926]: pgmap v57: 129 pgs: 129 active+clean; 855 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 20 op/s 2024-09-19T09:04:50.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:50 smithi184 ceph-mon[35007]: pgmap v58: 129 pgs: 129 active+clean; 855 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:04:50.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:50 smithi122 ceph-mon[34247]: pgmap v58: 129 pgs: 129 active+clean; 855 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:04:50.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:50 smithi083 ceph-mon[30926]: pgmap v58: 129 pgs: 129 active+clean; 855 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:04:52.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:52 smithi184 ceph-mon[35007]: pgmap v59: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:04:52.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:52 smithi122 ceph-mon[34247]: pgmap v59: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:04:52.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:52 smithi083 ceph-mon[30926]: pgmap v59: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:04:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:54 smithi184 ceph-mon[35007]: pgmap v60: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:04:54.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:54 smithi122 ceph-mon[34247]: pgmap v60: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:04:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:54 smithi083 ceph-mon[30926]: pgmap v60: 129 pgs: 129 active+clean; 1011 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:04:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:56 smithi184 ceph-mon[35007]: pgmap v61: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 37 MiB/s wr, 28 op/s 2024-09-19T09:04:56.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:56 smithi122 ceph-mon[34247]: pgmap v61: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 37 MiB/s wr, 28 op/s 2024-09-19T09:04:56.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:56 smithi083 ceph-mon[30926]: pgmap v61: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 37 MiB/s wr, 28 op/s 2024-09-19T09:04:58.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:04:58 smithi184 ceph-mon[35007]: pgmap v62: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 19 op/s 2024-09-19T09:04:58.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:04:58 smithi122 ceph-mon[34247]: pgmap v62: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 19 op/s 2024-09-19T09:04:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:04:58 smithi083 ceph-mon[30926]: pgmap v62: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 MiB/s wr, 19 op/s 2024-09-19T09:05:00.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:00 smithi184 ceph-mon[35007]: pgmap v63: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:00.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:00 smithi122 ceph-mon[34247]: pgmap v63: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:00.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:00 smithi083 ceph-mon[30926]: pgmap v63: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:02.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:02 smithi184 ceph-mon[35007]: pgmap v64: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 39 MiB/s wr, 43 op/s 2024-09-19T09:05:02.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:02 smithi122 ceph-mon[34247]: pgmap v64: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 39 MiB/s wr, 43 op/s 2024-09-19T09:05:02.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:02 smithi083 ceph-mon[30926]: pgmap v64: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 39 MiB/s wr, 43 op/s 2024-09-19T09:05:04.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:04 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:04.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:04 smithi122 ceph-mon[34247]: pgmap v65: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 34 op/s 2024-09-19T09:05:04.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:04 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:04.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:04 smithi083 ceph-mon[30926]: pgmap v65: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 34 op/s 2024-09-19T09:05:05.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:04 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:05.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:04 smithi184 ceph-mon[35007]: pgmap v65: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 34 op/s 2024-09-19T09:05:05.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:05.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:05 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:05.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:05.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:05.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:05 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:06.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:05 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:06 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:06 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:06 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:06 smithi122 ceph-mon[34247]: pgmap v66: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 MiB/s wr, 44 op/s 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:06 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:06 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:06 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:06.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:06 smithi083 ceph-mon[30926]: pgmap v66: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 MiB/s wr, 44 op/s 2024-09-19T09:05:07.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:06 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:06 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:06 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:05:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:06 smithi184 ceph-mon[35007]: pgmap v66: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 MiB/s wr, 44 op/s 2024-09-19T09:05:08.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:08 smithi184 ceph-mon[35007]: pgmap v67: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 35 op/s 2024-09-19T09:05:08.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:08 smithi122 ceph-mon[34247]: pgmap v67: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 35 op/s 2024-09-19T09:05:08.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:08 smithi083 ceph-mon[30926]: pgmap v67: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 MiB/s wr, 35 op/s 2024-09-19T09:05:10.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:10 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:10.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:10 smithi122 ceph-mon[34247]: pgmap v68: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 34 op/s 2024-09-19T09:05:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:10 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:10 smithi083 ceph-mon[30926]: pgmap v68: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 34 op/s 2024-09-19T09:05:10.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:10 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:10.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:10 smithi184 ceph-mon[35007]: pgmap v68: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 MiB/s wr, 34 op/s 2024-09-19T09:05:12.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:12 smithi184 ceph-mon[35007]: pgmap v69: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 44 op/s 2024-09-19T09:05:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:12 smithi122 ceph-mon[34247]: pgmap v69: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 44 op/s 2024-09-19T09:05:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:12 smithi083 ceph-mon[30926]: pgmap v69: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 44 op/s 2024-09-19T09:05:14.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:14 smithi184 ceph-mon[35007]: pgmap v70: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:05:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:14 smithi122 ceph-mon[34247]: pgmap v70: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:05:14.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:14 smithi083 ceph-mon[30926]: pgmap v70: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:05:16.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:16 smithi184 ceph-mon[35007]: pgmap v71: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:05:16.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:16 smithi122 ceph-mon[34247]: pgmap v71: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:05:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:16 smithi083 ceph-mon[30926]: pgmap v71: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:05:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:18 smithi184 ceph-mon[35007]: pgmap v72: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:18.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:18 smithi122 ceph-mon[34247]: pgmap v72: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:18 smithi083 ceph-mon[30926]: pgmap v72: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:20 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:20 smithi122 ceph-mon[34247]: pgmap v73: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:20 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:20 smithi083 ceph-mon[30926]: pgmap v73: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:20.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:20 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:05:20.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:20 smithi184 ceph-mon[35007]: pgmap v73: 129 pgs: 129 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:22.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:22 smithi184 ceph-mon[35007]: pgmap v74: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:22.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:22 smithi122 ceph-mon[34247]: pgmap v74: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:22 smithi083 ceph-mon[30926]: pgmap v74: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:24 smithi184 ceph-mon[35007]: pgmap v75: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:24.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:24 smithi122 ceph-mon[34247]: pgmap v75: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:24 smithi083 ceph-mon[30926]: pgmap v75: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:26.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:26 smithi184 ceph-mon[35007]: pgmap v76: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:26.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:26 smithi122 ceph-mon[34247]: pgmap v76: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:26.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:26 smithi083 ceph-mon[30926]: pgmap v76: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:28.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:28 smithi184 ceph-mon[35007]: pgmap v77: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:28.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:28 smithi122 ceph-mon[34247]: pgmap v77: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:28.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:28 smithi083 ceph-mon[30926]: pgmap v77: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:30.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:30 smithi184 ceph-mon[35007]: pgmap v78: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:30 smithi122 ceph-mon[34247]: pgmap v78: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:30.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:30 smithi083 ceph-mon[30926]: pgmap v78: 129 pgs: 129 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:05:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:32 smithi184 ceph-mon[35007]: pgmap v79: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:32 smithi122 ceph-mon[34247]: pgmap v79: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:32 smithi083 ceph-mon[30926]: pgmap v79: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 MiB/s wr, 29 op/s 2024-09-19T09:05:34.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:34 smithi184 ceph-mon[35007]: pgmap v80: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:34 smithi122 ceph-mon[34247]: pgmap v80: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:34 smithi083 ceph-mon[30926]: pgmap v80: 129 pgs: 129 active+clean; 2.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:36 smithi184 ceph-mon[35007]: pgmap v81: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:36.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:36 smithi122 ceph-mon[34247]: pgmap v81: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:36 smithi083 ceph-mon[30926]: pgmap v81: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:38 smithi184 ceph-mon[35007]: pgmap v82: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:38.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:38 smithi122 ceph-mon[34247]: pgmap v82: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:38 smithi083 ceph-mon[30926]: pgmap v82: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:40.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:40 smithi184 ceph-mon[35007]: pgmap v83: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:40.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:40 smithi122 ceph-mon[34247]: pgmap v83: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:40 smithi083 ceph-mon[30926]: pgmap v83: 129 pgs: 129 active+clean; 2.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:42.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:42 smithi184 ceph-mon[35007]: pgmap v84: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:42.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:42 smithi122 ceph-mon[34247]: pgmap v84: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:42.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:42 smithi083 ceph-mon[30926]: pgmap v84: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:44.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:44 smithi184 ceph-mon[35007]: pgmap v85: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:44 smithi122 ceph-mon[34247]: pgmap v85: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:44.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:44 smithi083 ceph-mon[30926]: pgmap v85: 129 pgs: 129 active+clean; 2.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:46 smithi184 ceph-mon[35007]: pgmap v86: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:46.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:46 smithi122 ceph-mon[34247]: pgmap v86: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:46.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:46 smithi083 ceph-mon[30926]: pgmap v86: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:05:48.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:48 smithi122 ceph-mon[34247]: pgmap v87: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:48.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:48 smithi083 ceph-mon[30926]: pgmap v87: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:48.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:48 smithi184 ceph-mon[35007]: pgmap v87: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:50.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:50 smithi122 ceph-mon[34247]: pgmap v88: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:50.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:50 smithi083 ceph-mon[30926]: pgmap v88: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:50.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:50 smithi184 ceph-mon[35007]: pgmap v88: 129 pgs: 129 active+clean; 2.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:05:52.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:52 smithi122 ceph-mon[34247]: pgmap v89: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:05:52.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:52 smithi083 ceph-mon[30926]: pgmap v89: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:05:52.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:52 smithi184 ceph-mon[35007]: pgmap v89: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:05:54.451 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:54 smithi184 ceph-mon[35007]: pgmap v90: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:05:54.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:54 smithi122 ceph-mon[34247]: pgmap v90: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:05:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:54 smithi083 ceph-mon[30926]: pgmap v90: 129 pgs: 129 active+clean; 2.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:05:57.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:57 smithi184 ceph-mon[35007]: pgmap v91: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:05:57.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:57 smithi122 ceph-mon[34247]: pgmap v91: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:05:57.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:57 smithi083 ceph-mon[30926]: pgmap v91: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:05:59.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:05:59 smithi122 ceph-mon[34247]: pgmap v92: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:05:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:05:59 smithi083 ceph-mon[30926]: pgmap v92: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:05:59.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:05:59 smithi184 ceph-mon[35007]: pgmap v92: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:01.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:01 smithi122 ceph-mon[34247]: pgmap v93: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:01.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:01 smithi083 ceph-mon[30926]: pgmap v93: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:01.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:01 smithi184 ceph-mon[35007]: pgmap v93: 129 pgs: 129 active+clean; 2.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:03 smithi122 ceph-mon[34247]: pgmap v94: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 42 op/s 2024-09-19T09:06:03.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:03 smithi083 ceph-mon[30926]: pgmap v94: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 42 op/s 2024-09-19T09:06:03.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:03 smithi184 ceph-mon[35007]: pgmap v94: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 42 op/s 2024-09-19T09:06:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:05 smithi122 ceph-mon[34247]: pgmap v95: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:05.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:05 smithi083 ceph-mon[30926]: pgmap v95: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:05.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:05 smithi184 ceph-mon[35007]: pgmap v95: 129 pgs: 129 active+clean; 3.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:06.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:06 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:06.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:06 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:06.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:06 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:07.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:07 smithi122 ceph-mon[34247]: pgmap v96: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:06:07.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:07 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:07.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:07 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:07.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:07 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:06:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:07 smithi083 ceph-mon[30926]: pgmap v96: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:06:07.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:07 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:07.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:07 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:07.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:07 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:06:07.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:07 smithi184 ceph-mon[35007]: pgmap v96: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:06:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:07 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:07 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:07 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:06:09.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:09 smithi122 ceph-mon[34247]: pgmap v97: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:09 smithi083 ceph-mon[30926]: pgmap v97: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:09.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:09 smithi184 ceph-mon[35007]: pgmap v97: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:11.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:11 smithi122 ceph-mon[34247]: pgmap v98: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:11 smithi083 ceph-mon[30926]: pgmap v98: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:11.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:11 smithi184 ceph-mon[35007]: pgmap v98: 129 pgs: 129 active+clean; 3.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:06:13.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:13 smithi122 ceph-mon[34247]: pgmap v99: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 43 op/s 2024-09-19T09:06:13.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:13 smithi083 ceph-mon[30926]: pgmap v99: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 43 op/s 2024-09-19T09:06:13.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:13 smithi184 ceph-mon[35007]: pgmap v99: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 43 op/s 2024-09-19T09:06:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:15 smithi122 ceph-mon[34247]: pgmap v100: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:06:15.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:15 smithi083 ceph-mon[30926]: pgmap v100: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:06:15.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:15 smithi184 ceph-mon[35007]: pgmap v100: 129 pgs: 129 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:06:17.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:17 smithi122 ceph-mon[34247]: pgmap v101: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:17.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:17 smithi083 ceph-mon[30926]: pgmap v101: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:17.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:17 smithi184 ceph-mon[35007]: pgmap v101: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:19.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:19 smithi122 ceph-mon[34247]: pgmap v102: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:19.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:19 smithi083 ceph-mon[30926]: pgmap v102: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:19 smithi184 ceph-mon[35007]: pgmap v102: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:21.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:21 smithi122 ceph-mon[34247]: pgmap v103: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:21.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:21 smithi083 ceph-mon[30926]: pgmap v103: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:21.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:21 smithi184 ceph-mon[35007]: pgmap v103: 129 pgs: 129 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:23.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:23 smithi122 ceph-mon[34247]: pgmap v104: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:06:23.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:23 smithi083 ceph-mon[30926]: pgmap v104: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:06:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:23 smithi184 ceph-mon[35007]: pgmap v104: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:06:25.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:25 smithi184 ceph-mon[35007]: pgmap v105: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:25.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:25 smithi122 ceph-mon[34247]: pgmap v105: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:25.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:25 smithi083 ceph-mon[30926]: pgmap v105: 129 pgs: 129 active+clean; 3.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:27.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:27 smithi122 ceph-mon[34247]: pgmap v106: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:27.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:27 smithi083 ceph-mon[30926]: pgmap v106: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:27 smithi184 ceph-mon[35007]: pgmap v106: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:29.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:29 smithi122 ceph-mon[34247]: pgmap v107: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:29.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:29 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:29.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:29 smithi083 ceph-mon[30926]: pgmap v107: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:29.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:29 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:29.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:29 smithi184 ceph-mon[35007]: pgmap v107: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:29 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:31.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:31 smithi122 ceph-mon[34247]: pgmap v108: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:31.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:31 smithi083 ceph-mon[30926]: pgmap v108: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:31.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:31 smithi184 ceph-mon[35007]: pgmap v108: 129 pgs: 129 active+clean; 3.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:33.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:33 smithi122 ceph-mon[34247]: pgmap v109: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:06:33.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:33 smithi083 ceph-mon[30926]: pgmap v109: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:06:33.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:33 smithi184 ceph-mon[35007]: pgmap v109: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:06:35.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:35 smithi122 ceph-mon[34247]: pgmap v110: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:35.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:35 smithi083 ceph-mon[30926]: pgmap v110: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:35.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:35 smithi184 ceph-mon[35007]: pgmap v110: 129 pgs: 129 active+clean; 4.0 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:37.460 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:37 smithi122 ceph-mon[34247]: pgmap v111: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:37.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:37 smithi083 ceph-mon[30926]: pgmap v111: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:37 smithi184 ceph-mon[35007]: pgmap v111: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:39.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:39 smithi122 ceph-mon[34247]: pgmap v112: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:39.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:39 smithi083 ceph-mon[30926]: pgmap v112: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:39.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:39 smithi184 ceph-mon[35007]: pgmap v112: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:41.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:41 smithi083 ceph-mon[30926]: pgmap v113: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:41 smithi184 ceph-mon[35007]: pgmap v113: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:41.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:41 smithi122 ceph-mon[34247]: pgmap v113: 129 pgs: 129 active+clean; 4.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:43.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:43 smithi184 ceph-mon[35007]: pgmap v114: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:06:43.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:43 smithi122 ceph-mon[34247]: pgmap v114: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:06:43.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:43 smithi083 ceph-mon[30926]: pgmap v114: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:06:44.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:44 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:44.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:44 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:44.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:44 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:45.613 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:45 smithi083 ceph-mon[30926]: pgmap v115: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:45.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:45 smithi184 ceph-mon[35007]: pgmap v115: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:45 smithi122 ceph-mon[34247]: pgmap v115: 129 pgs: 129 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:06:47.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:47 smithi184 ceph-mon[35007]: pgmap v116: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:47.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:47 smithi122 ceph-mon[34247]: pgmap v116: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:47 smithi083 ceph-mon[30926]: pgmap v116: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:06:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:49 smithi184 ceph-mon[35007]: pgmap v117: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:49 smithi122 ceph-mon[34247]: pgmap v117: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:49 smithi083 ceph-mon[30926]: pgmap v117: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:51.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:51 smithi184 ceph-mon[35007]: pgmap v118: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:51.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:51 smithi122 ceph-mon[34247]: pgmap v118: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:51.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:51 smithi083 ceph-mon[30926]: pgmap v118: 129 pgs: 129 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:53.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:53 smithi184 ceph-mon[35007]: pgmap v119: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:53.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:53 smithi122 ceph-mon[34247]: pgmap v119: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:53.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:53 smithi083 ceph-mon[30926]: pgmap v119: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:54.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:54 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:54.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:54 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:54.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:54 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:06:55.551 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:55 smithi184 ceph-mon[35007]: pgmap v120: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:06:55.612 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:55 smithi122 ceph-mon[34247]: pgmap v120: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:06:55.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:55 smithi083 ceph-mon[30926]: pgmap v120: 129 pgs: 129 active+clean; 4.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:06:57.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:57 smithi184 ceph-mon[35007]: pgmap v121: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:57.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:57 smithi122 ceph-mon[34247]: pgmap v121: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:57.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:57 smithi083 ceph-mon[30926]: pgmap v121: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:06:59.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:06:59 smithi184 ceph-mon[35007]: pgmap v122: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:59.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:06:59 smithi122 ceph-mon[34247]: pgmap v122: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:06:59.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:06:59 smithi083 ceph-mon[30926]: pgmap v122: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:01.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:01 smithi184 ceph-mon[35007]: pgmap v123: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:01.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:01 smithi122 ceph-mon[34247]: pgmap v123: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:01.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:01 smithi083 ceph-mon[30926]: pgmap v123: 129 pgs: 129 active+clean; 4.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:03.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:03 smithi184 ceph-mon[35007]: pgmap v124: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:03.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:03 smithi122 ceph-mon[34247]: pgmap v124: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:03.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:03 smithi083 ceph-mon[30926]: pgmap v124: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:05.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:05 smithi184 ceph-mon[35007]: pgmap v125: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:07:05.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:05 smithi122 ceph-mon[34247]: pgmap v125: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:07:05.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:05 smithi083 ceph-mon[30926]: pgmap v125: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:07:07.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:07 smithi184 ceph-mon[35007]: pgmap v126: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:07 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:07 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:07 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:07 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:07:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:07 smithi122 ceph-mon[34247]: pgmap v126: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:07 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:07 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:07 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:07 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:07:07.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:07 smithi083 ceph-mon[30926]: pgmap v126: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:07.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:07 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:07.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:07 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:07.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:07 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:07.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:07 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:07:09.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:09 smithi184 ceph-mon[35007]: pgmap v127: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:07:09.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:09 smithi122 ceph-mon[34247]: pgmap v127: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:07:09.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:09 smithi083 ceph-mon[30926]: pgmap v127: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:07:11.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:11 smithi184 ceph-mon[35007]: pgmap v128: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:07:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:11 smithi122 ceph-mon[34247]: pgmap v128: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:07:11.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:11 smithi083 ceph-mon[30926]: pgmap v128: 129 pgs: 129 active+clean; 5.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 33 op/s 2024-09-19T09:07:13.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:13 smithi184 ceph-mon[35007]: pgmap v129: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:13.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:13 smithi122 ceph-mon[34247]: pgmap v129: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:13.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:13 smithi083 ceph-mon[30926]: pgmap v129: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:07:15.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:15 smithi184 ceph-mon[35007]: pgmap v130: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:15.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:15 smithi122 ceph-mon[34247]: pgmap v130: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:15.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:15 smithi083 ceph-mon[30926]: pgmap v130: 129 pgs: 129 active+clean; 5.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:17.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:17 smithi184 ceph-mon[35007]: pgmap v131: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:17.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:17 smithi122 ceph-mon[34247]: pgmap v131: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:17.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:17 smithi083 ceph-mon[30926]: pgmap v131: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:19 smithi184 ceph-mon[35007]: pgmap v132: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:19.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:19 smithi122 ceph-mon[34247]: pgmap v132: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:19.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:19 smithi083 ceph-mon[30926]: pgmap v132: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:20.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:20 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:20.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:20 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:20.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:20 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:21.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:21 smithi184 ceph-mon[35007]: pgmap v133: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:21 smithi122 ceph-mon[34247]: pgmap v133: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:21 smithi083 ceph-mon[30926]: pgmap v133: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:23 smithi184 ceph-mon[35007]: pgmap v134: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:23.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:23 smithi122 ceph-mon[34247]: pgmap v134: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:23 smithi083 ceph-mon[30926]: pgmap v134: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:25.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:25 smithi184 ceph-mon[35007]: pgmap v135: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:25.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:25 smithi122 ceph-mon[34247]: pgmap v135: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:25 smithi083 ceph-mon[30926]: pgmap v135: 129 pgs: 129 active+clean; 5.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:27 smithi184 ceph-mon[35007]: pgmap v136: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:07:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:27 smithi122 ceph-mon[34247]: pgmap v136: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:07:27.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:27 smithi083 ceph-mon[30926]: pgmap v136: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:07:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:29 smithi184 ceph-mon[35007]: pgmap v137: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:29 smithi122 ceph-mon[34247]: pgmap v137: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:29 smithi083 ceph-mon[30926]: pgmap v137: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:30.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:30 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:30 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:30.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:30 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:31.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:31 smithi184 ceph-mon[35007]: pgmap v138: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:31 smithi122 ceph-mon[34247]: pgmap v138: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:31 smithi083 ceph-mon[30926]: pgmap v138: 129 pgs: 129 active+clean; 5.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:33.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:33 smithi184 ceph-mon[35007]: pgmap v139: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:33.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:33 smithi122 ceph-mon[34247]: pgmap v139: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:33.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:33 smithi083 ceph-mon[30926]: pgmap v139: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:35.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:35 smithi184 ceph-mon[35007]: pgmap v140: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:35.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:35 smithi122 ceph-mon[34247]: pgmap v140: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:35.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:35 smithi083 ceph-mon[30926]: pgmap v140: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:37 smithi184 ceph-mon[35007]: pgmap v141: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:07:37.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:37 smithi122 ceph-mon[34247]: pgmap v141: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:07:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:37 smithi083 ceph-mon[30926]: pgmap v141: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:07:39.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:39 smithi184 ceph-mon[35007]: pgmap v142: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:39.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:39 smithi122 ceph-mon[34247]: pgmap v142: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:39.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:39 smithi083 ceph-mon[30926]: pgmap v142: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:40.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:40 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:40.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:40 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:40.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:40 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:07:41.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:41 smithi184 ceph-mon[35007]: pgmap v143: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:41.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:41 smithi122 ceph-mon[34247]: pgmap v143: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:41 smithi083 ceph-mon[30926]: pgmap v143: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:43.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:43 smithi184 ceph-mon[35007]: pgmap v144: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:43.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:43 smithi122 ceph-mon[34247]: pgmap v144: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:43.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:43 smithi083 ceph-mon[30926]: pgmap v144: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:45 smithi184 ceph-mon[35007]: pgmap v145: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:45 smithi122 ceph-mon[34247]: pgmap v145: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:45.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:45 smithi083 ceph-mon[30926]: pgmap v145: 129 pgs: 129 active+clean; 6.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:47.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:47 smithi184 ceph-mon[35007]: pgmap v146: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:07:47.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:47 smithi122 ceph-mon[34247]: pgmap v146: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:07:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:47 smithi083 ceph-mon[30926]: pgmap v146: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:07:49.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:49 smithi184 ceph-mon[35007]: pgmap v147: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:49.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:49 smithi083 ceph-mon[30926]: pgmap v147: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:49.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:49 smithi122 ceph-mon[34247]: pgmap v147: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:51.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:51 smithi184 ceph-mon[35007]: pgmap v148: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:51.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:51 smithi122 ceph-mon[34247]: pgmap v148: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:51.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:51 smithi083 ceph-mon[30926]: pgmap v148: 129 pgs: 129 active+clean; 6.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:07:53.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:53 smithi184 ceph-mon[35007]: pgmap v149: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:53.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:53 smithi122 ceph-mon[34247]: pgmap v149: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:53.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:53 smithi083 ceph-mon[30926]: pgmap v149: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:55.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:55 smithi184 ceph-mon[35007]: pgmap v150: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:55.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:55 smithi122 ceph-mon[34247]: pgmap v150: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:55.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:55 smithi083 ceph-mon[30926]: pgmap v150: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:57.654 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:57 smithi184 ceph-mon[35007]: pgmap v151: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:57.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:57 smithi122 ceph-mon[34247]: pgmap v151: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:57.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:57 smithi083 ceph-mon[30926]: pgmap v151: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:07:59.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:07:59 smithi184 ceph-mon[35007]: pgmap v152: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:59.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:07:59 smithi122 ceph-mon[34247]: pgmap v152: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:07:59.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:07:59 smithi083 ceph-mon[30926]: pgmap v152: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:01.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:01 smithi184 ceph-mon[35007]: pgmap v153: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:01.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:01 smithi122 ceph-mon[34247]: pgmap v153: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:01.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:01 smithi083 ceph-mon[30926]: pgmap v153: 129 pgs: 129 active+clean; 6.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:03.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:03 smithi184 ceph-mon[35007]: pgmap v154: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:03.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:03 smithi122 ceph-mon[34247]: pgmap v154: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:03.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:03 smithi083 ceph-mon[30926]: pgmap v154: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:05.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:05 smithi184 ceph-mon[35007]: pgmap v155: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:05.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:05 smithi122 ceph-mon[34247]: pgmap v155: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:05.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:05 smithi083 ceph-mon[30926]: pgmap v155: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:07 smithi184 ceph-mon[35007]: pgmap v156: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:07 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:07 smithi122 ceph-mon[34247]: pgmap v156: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:07 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:07.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:07 smithi083 ceph-mon[30926]: pgmap v156: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:07.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:07 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:08.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:08 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:08.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:08 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:08.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:08 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:08:08.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:08 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:08.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:08 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:08.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:08 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:08:08.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:08 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:08.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:08 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:08.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:08 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:08:09.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:09 smithi184 ceph-mon[35007]: pgmap v157: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:09.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:09 smithi122 ceph-mon[34247]: pgmap v157: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:09.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:09 smithi083 ceph-mon[30926]: pgmap v157: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:11.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:11 smithi184 ceph-mon[35007]: pgmap v158: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:11 smithi122 ceph-mon[34247]: pgmap v158: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:11.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:11 smithi083 ceph-mon[30926]: pgmap v158: 129 pgs: 129 active+clean; 6.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:08:13.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:13 smithi184 ceph-mon[35007]: pgmap v159: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:13.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:13 smithi122 ceph-mon[34247]: pgmap v159: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:13.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:13 smithi083 ceph-mon[30926]: pgmap v159: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:08:15.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:15 smithi083 ceph-mon[30926]: pgmap v160: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:15.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:15 smithi184 ceph-mon[35007]: pgmap v160: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:15.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:15 smithi122 ceph-mon[34247]: pgmap v160: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:17.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:17 smithi184 ceph-mon[35007]: pgmap v161: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:08:17.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:17 smithi122 ceph-mon[34247]: pgmap v161: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:08:17.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:17 smithi083 ceph-mon[30926]: pgmap v161: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 MiB/s wr, 28 op/s 2024-09-19T09:08:19.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:19 smithi184 ceph-mon[35007]: pgmap v162: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:08:19.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:19 smithi122 ceph-mon[34247]: pgmap v162: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:08:19.965 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:19 smithi083 ceph-mon[30926]: pgmap v162: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:08:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:21 smithi184 ceph-mon[35007]: pgmap v163: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:08:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:21 smithi122 ceph-mon[34247]: pgmap v163: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:08:21.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:21 smithi083 ceph-mon[30926]: pgmap v163: 129 pgs: 129 active+clean; 7.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:08:23.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:23 smithi184 ceph-mon[35007]: pgmap v164: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:23.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:23 smithi122 ceph-mon[34247]: pgmap v164: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:23.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:23 smithi083 ceph-mon[30926]: pgmap v164: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:25.763 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:25 smithi122 ceph-mon[34247]: pgmap v165: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:25 smithi184 ceph-mon[35007]: pgmap v165: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:25 smithi083 ceph-mon[30926]: pgmap v165: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:27.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:27 smithi184 ceph-mon[35007]: pgmap v166: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:27.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:27 smithi122 ceph-mon[34247]: pgmap v166: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:27.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:27 smithi083 ceph-mon[30926]: pgmap v166: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:29.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:29 smithi184 ceph-mon[35007]: pgmap v167: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:29.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:29 smithi122 ceph-mon[34247]: pgmap v167: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:29.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:29 smithi083 ceph-mon[30926]: pgmap v167: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:31 smithi184 ceph-mon[35007]: pgmap v168: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:31 smithi122 ceph-mon[34247]: pgmap v168: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:31.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:31 smithi083 ceph-mon[30926]: pgmap v168: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:33.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:33 smithi184 ceph-mon[35007]: pgmap v169: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:33.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:33 smithi122 ceph-mon[34247]: pgmap v169: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:33 smithi083 ceph-mon[30926]: pgmap v169: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:35.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:35 smithi184 ceph-mon[35007]: pgmap v170: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:35.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:35 smithi122 ceph-mon[34247]: pgmap v170: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:35.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:35 smithi083 ceph-mon[30926]: pgmap v170: 129 pgs: 129 active+clean; 7.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:37.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:37 smithi184 ceph-mon[35007]: pgmap v171: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:37 smithi122 ceph-mon[34247]: pgmap v171: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:37.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:37 smithi083 ceph-mon[30926]: pgmap v171: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:39.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:39 smithi184 ceph-mon[35007]: pgmap v172: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:39 smithi122 ceph-mon[34247]: pgmap v172: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:39.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:39 smithi083 ceph-mon[30926]: pgmap v172: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:41 smithi184 ceph-mon[35007]: pgmap v173: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:41 smithi122 ceph-mon[34247]: pgmap v173: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:41.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:41 smithi083 ceph-mon[30926]: pgmap v173: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:43.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:43 smithi184 ceph-mon[35007]: pgmap v174: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:08:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:43 smithi122 ceph-mon[34247]: pgmap v174: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:08:43.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:43 smithi083 ceph-mon[30926]: pgmap v174: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:08:45.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:45 smithi184 ceph-mon[35007]: pgmap v175: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:45 smithi122 ceph-mon[34247]: pgmap v175: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:45 smithi083 ceph-mon[30926]: pgmap v175: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:47.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:47 smithi184 ceph-mon[35007]: pgmap v176: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:47.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:47 smithi122 ceph-mon[34247]: pgmap v176: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:47.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:47 smithi083 ceph-mon[30926]: pgmap v176: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:49.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:49 smithi184 ceph-mon[35007]: pgmap v177: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:49.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:49 smithi122 ceph-mon[34247]: pgmap v177: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:49.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:49 smithi083 ceph-mon[30926]: pgmap v177: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:51.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:51 smithi184 ceph-mon[35007]: pgmap v178: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:51.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:51 smithi122 ceph-mon[34247]: pgmap v178: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:51.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:51 smithi083 ceph-mon[30926]: pgmap v178: 129 pgs: 129 active+clean; 8.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:53.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:53 smithi184 ceph-mon[35007]: pgmap v179: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:08:53.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:53 smithi122 ceph-mon[34247]: pgmap v179: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:08:53.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:53 smithi083 ceph-mon[30926]: pgmap v179: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:08:55.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:55 smithi184 ceph-mon[35007]: pgmap v180: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:55.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:55 smithi122 ceph-mon[34247]: pgmap v180: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:55.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:55 smithi083 ceph-mon[30926]: pgmap v180: 129 pgs: 129 active+clean; 8.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:08:57.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:57 smithi184 ceph-mon[35007]: pgmap v181: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:57.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:57 smithi122 ceph-mon[34247]: pgmap v181: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:57.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:57 smithi083 ceph-mon[30926]: pgmap v181: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:08:59.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:08:59 smithi184 ceph-mon[35007]: pgmap v182: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:59.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:08:59 smithi122 ceph-mon[34247]: pgmap v182: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:08:59.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:08:59 smithi083 ceph-mon[30926]: pgmap v182: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:01 smithi184 ceph-mon[35007]: pgmap v183: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:01.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:01 smithi122 ceph-mon[34247]: pgmap v183: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:01.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:01 smithi083 ceph-mon[30926]: pgmap v183: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:03 smithi184 ceph-mon[35007]: pgmap v184: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 42 op/s 2024-09-19T09:09:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:03 smithi122 ceph-mon[34247]: pgmap v184: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 42 op/s 2024-09-19T09:09:03.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:03 smithi083 ceph-mon[30926]: pgmap v184: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 42 op/s 2024-09-19T09:09:05.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:05 smithi184 ceph-mon[35007]: pgmap v185: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:05 smithi122 ceph-mon[34247]: pgmap v185: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:05.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:05 smithi083 ceph-mon[30926]: pgmap v185: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:07.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:07 smithi184 ceph-mon[35007]: pgmap v186: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:09:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:07 smithi122 ceph-mon[34247]: pgmap v186: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:09:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:07 smithi083 ceph-mon[30926]: pgmap v186: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-19T09:09:08.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:08 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:08.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:08 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:08.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:08 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:08.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:08 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:09:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:08 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:08 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:08 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:08 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:09:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:08 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:08.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:08 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:08.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:08 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:08.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:08 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:09:10.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:10 smithi184 ceph-mon[35007]: pgmap v187: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:10.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:10 smithi122 ceph-mon[34247]: pgmap v187: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:10.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:10 smithi083 ceph-mon[30926]: pgmap v187: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:12 smithi184 ceph-mon[35007]: pgmap v188: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:12.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:12 smithi122 ceph-mon[34247]: pgmap v188: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:12.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:12 smithi083 ceph-mon[30926]: pgmap v188: 129 pgs: 129 active+clean; 8.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2024-09-19T09:09:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:14 smithi184 ceph-mon[35007]: pgmap v189: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 44 op/s 2024-09-19T09:09:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:14 smithi122 ceph-mon[34247]: pgmap v189: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 44 op/s 2024-09-19T09:09:14.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:14 smithi083 ceph-mon[30926]: pgmap v189: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 44 op/s 2024-09-19T09:09:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:16 smithi184 ceph-mon[35007]: pgmap v190: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:16 smithi122 ceph-mon[34247]: pgmap v190: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:16 smithi083 ceph-mon[30926]: pgmap v190: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:18.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:18 smithi184 ceph-mon[35007]: pgmap v191: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 37 MiB/s wr, 30 op/s 2024-09-19T09:09:18.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:18 smithi122 ceph-mon[34247]: pgmap v191: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 37 MiB/s wr, 30 op/s 2024-09-19T09:09:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:18 smithi083 ceph-mon[30926]: pgmap v191: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 37 MiB/s wr, 30 op/s 2024-09-19T09:09:20.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:20 smithi184 ceph-mon[35007]: pgmap v192: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:20 smithi122 ceph-mon[34247]: pgmap v192: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:20 smithi083 ceph-mon[30926]: pgmap v192: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:22.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:22 smithi184 ceph-mon[35007]: pgmap v193: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:22.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:22 smithi122 ceph-mon[34247]: pgmap v193: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:22.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:22 smithi083 ceph-mon[30926]: pgmap v193: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:09:24.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:24 smithi184 ceph-mon[35007]: pgmap v194: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:09:24.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:24 smithi122 ceph-mon[34247]: pgmap v194: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:09:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:24 smithi083 ceph-mon[30926]: pgmap v194: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:09:26.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:26 smithi184 ceph-mon[35007]: pgmap v195: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:26.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:26 smithi122 ceph-mon[34247]: pgmap v195: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:26.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:26 smithi083 ceph-mon[30926]: pgmap v195: 129 pgs: 129 active+clean; 9.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:28.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:28 smithi184 ceph-mon[35007]: pgmap v196: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:28.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:28 smithi122 ceph-mon[34247]: pgmap v196: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:28.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:28 smithi083 ceph-mon[30926]: pgmap v196: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:30 smithi184 ceph-mon[35007]: pgmap v197: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:30.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:30 smithi122 ceph-mon[34247]: pgmap v197: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:30.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:30 smithi083 ceph-mon[30926]: pgmap v197: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:32.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:32 smithi184 ceph-mon[35007]: pgmap v198: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:32.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:32 smithi122 ceph-mon[34247]: pgmap v198: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:32.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:32 smithi083 ceph-mon[30926]: pgmap v198: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:34.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:34 smithi184 ceph-mon[35007]: pgmap v199: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:09:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:34 smithi122 ceph-mon[34247]: pgmap v199: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:09:34.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:34 smithi083 ceph-mon[30926]: pgmap v199: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 MiB/s wr, 27 op/s 2024-09-19T09:09:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:36 smithi184 ceph-mon[35007]: pgmap v200: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:36.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:36 smithi122 ceph-mon[34247]: pgmap v200: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:36.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:36 smithi083 ceph-mon[30926]: pgmap v200: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:38.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:38 smithi184 ceph-mon[35007]: pgmap v201: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:38.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:38 smithi122 ceph-mon[34247]: pgmap v201: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:38.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:38 smithi083 ceph-mon[30926]: pgmap v201: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:40.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:40 smithi184 ceph-mon[35007]: pgmap v202: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:40.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:40 smithi122 ceph-mon[34247]: pgmap v202: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:40.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:40 smithi083 ceph-mon[30926]: pgmap v202: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:42.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:42 smithi184 ceph-mon[35007]: pgmap v203: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:42.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:42 smithi122 ceph-mon[34247]: pgmap v203: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:42.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:42 smithi083 ceph-mon[30926]: pgmap v203: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-19T09:09:44.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:44 smithi184 ceph-mon[35007]: pgmap v204: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:09:44.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:44 smithi122 ceph-mon[34247]: pgmap v204: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:09:44.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:44 smithi083 ceph-mon[30926]: pgmap v204: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 27 op/s 2024-09-19T09:09:45.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:45 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:09:45.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:45 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:09:45.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:45 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:09:46.362 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:46 smithi083 ceph-mon[30926]: pgmap v205: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:46.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:46 smithi184 ceph-mon[35007]: pgmap v205: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:46.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:46 smithi122 ceph-mon[34247]: pgmap v205: 129 pgs: 129 active+clean; 9.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 18 op/s 2024-09-19T09:09:48.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:48 smithi184 ceph-mon[35007]: pgmap v206: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:48.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:48 smithi122 ceph-mon[34247]: pgmap v206: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:48.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:48 smithi083 ceph-mon[30926]: pgmap v206: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:50.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:50 smithi184 ceph-mon[35007]: pgmap v207: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:50.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:50 smithi122 ceph-mon[34247]: pgmap v207: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:50.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:50 smithi083 ceph-mon[30926]: pgmap v207: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:52.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:52 smithi184 ceph-mon[35007]: pgmap v208: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:52.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:52 smithi122 ceph-mon[34247]: pgmap v208: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:52.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:52 smithi083 ceph-mon[30926]: pgmap v208: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:54.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:54 smithi184 ceph-mon[35007]: pgmap v209: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:54.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:54 smithi122 ceph-mon[34247]: pgmap v209: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:54.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:54 smithi083 ceph-mon[30926]: pgmap v209: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 28 op/s 2024-09-19T09:09:56.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:56 smithi184 ceph-mon[35007]: pgmap v210: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:09:56.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:56 smithi122 ceph-mon[34247]: pgmap v210: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:09:56.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:56 smithi083 ceph-mon[30926]: pgmap v210: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:09:58.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:58 smithi184 ceph-mon[35007]: pgmap v211: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:09:58.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:58 smithi122 ceph-mon[34247]: pgmap v211: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:09:58.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:58 smithi083 ceph-mon[30926]: pgmap v211: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:09:59.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:09:59 smithi184 ceph-mon[35007]: pgmap v212: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:59.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:09:59 smithi122 ceph-mon[34247]: pgmap v212: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:09:59.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:09:59 smithi083 ceph-mon[30926]: pgmap v212: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:00.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:00 smithi184 ceph-mon[35007]: overall HEALTH_OK 2024-09-19T09:10:00.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:00 smithi122 ceph-mon[34247]: overall HEALTH_OK 2024-09-19T09:10:00.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:00 smithi083 ceph-mon[30926]: overall HEALTH_OK 2024-09-19T09:10:01.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:01 smithi184 ceph-mon[35007]: pgmap v213: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:01.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:01 smithi122 ceph-mon[34247]: pgmap v213: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:01.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:01 smithi083 ceph-mon[30926]: pgmap v213: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:03.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:03 smithi122 ceph-mon[34247]: pgmap v214: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 45 op/s 2024-09-19T09:10:03.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:03 smithi083 ceph-mon[30926]: pgmap v214: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 45 op/s 2024-09-19T09:10:03.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:03 smithi184 ceph-mon[35007]: pgmap v214: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 45 op/s 2024-09-19T09:10:05.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:05 smithi184 ceph-mon[35007]: pgmap v215: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 36 op/s 2024-09-19T09:10:05.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:05 smithi122 ceph-mon[34247]: pgmap v215: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 36 op/s 2024-09-19T09:10:05.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:05 smithi083 ceph-mon[30926]: pgmap v215: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 36 op/s 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:07 smithi122 ceph-mon[34247]: pgmap v216: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 46 op/s 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:07 smithi083 ceph-mon[30926]: pgmap v216: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 46 op/s 2024-09-19T09:10:07.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:07 smithi184 ceph-mon[35007]: pgmap v216: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 46 op/s 2024-09-19T09:10:08.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:08 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:08.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:08 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:08.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:08 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:09.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:09 smithi083 ceph-mon[30926]: pgmap v217: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 36 op/s 2024-09-19T09:10:09.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:09 smithi083 ceph-mon[30926]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T09:10:09.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:09 smithi184 ceph-mon[35007]: pgmap v217: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 36 op/s 2024-09-19T09:10:09.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:09 smithi184 ceph-mon[35007]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T09:10:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:09 smithi122 ceph-mon[34247]: pgmap v217: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 36 op/s 2024-09-19T09:10:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:09 smithi122 ceph-mon[34247]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T09:10:10.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:10 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:10:10.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:10 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:10:10.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:10 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:10:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:11 smithi184 ceph-mon[35007]: pgmap v219: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 30 MiB/s wr, 44 op/s 2024-09-19T09:10:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:11 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:11 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:11 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:10:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:11 smithi122 ceph-mon[34247]: pgmap v219: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 30 MiB/s wr, 44 op/s 2024-09-19T09:10:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:11 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:11 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:11 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:10:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:11 smithi083 ceph-mon[30926]: pgmap v219: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 30 MiB/s wr, 44 op/s 2024-09-19T09:10:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:11 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:11 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:11 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:10:13.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:13 smithi184 ceph-mon[35007]: pgmap v220: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:13.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:13 smithi122 ceph-mon[34247]: pgmap v220: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:13.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:13 smithi083 ceph-mon[30926]: pgmap v220: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:15 smithi184 ceph-mon[35007]: pgmap v221: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:15.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:15 smithi122 ceph-mon[34247]: pgmap v221: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:15 smithi083 ceph-mon[30926]: pgmap v221: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:16.612 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:16 smithi083 ceph-mon[30926]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T09:10:16.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:16 smithi184 ceph-mon[35007]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T09:10:16.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:16 smithi122 ceph-mon[34247]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T09:10:17.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:17 smithi184 ceph-mon[35007]: pgmap v223: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 31 op/s 2024-09-19T09:10:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:17 smithi122 ceph-mon[34247]: pgmap v223: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 31 op/s 2024-09-19T09:10:17.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:17 smithi083 ceph-mon[30926]: pgmap v223: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 31 op/s 2024-09-19T09:10:19.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:19 smithi184 ceph-mon[35007]: pgmap v224: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:19.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:19 smithi122 ceph-mon[34247]: pgmap v224: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:19.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:19 smithi083 ceph-mon[30926]: pgmap v224: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:10:21.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:21 smithi184 ceph-mon[35007]: pgmap v225: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:21 smithi122 ceph-mon[34247]: pgmap v225: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:21.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:21 smithi083 ceph-mon[30926]: pgmap v225: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:23 smithi184 ceph-mon[35007]: pgmap v226: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:23.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:23 smithi122 ceph-mon[34247]: pgmap v226: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:23.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:23 smithi083 ceph-mon[30926]: pgmap v226: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:25.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:25 smithi184 ceph-mon[35007]: pgmap v227: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:25.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:25 smithi122 ceph-mon[34247]: pgmap v227: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:25.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:25 smithi083 ceph-mon[30926]: pgmap v227: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 30 MiB/s wr, 24 op/s 2024-09-19T09:10:27.596 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:27 smithi083 ceph-mon[30926]: pgmap v228: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 42 MiB/s wr, 33 op/s 2024-09-19T09:10:27.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:27 smithi184 ceph-mon[35007]: pgmap v228: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 42 MiB/s wr, 33 op/s 2024-09-19T09:10:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:27 smithi122 ceph-mon[34247]: pgmap v228: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 42 MiB/s wr, 33 op/s 2024-09-19T09:10:29.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:29 smithi184 ceph-mon[35007]: pgmap v229: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:29 smithi122 ceph-mon[34247]: pgmap v229: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:29 smithi083 ceph-mon[30926]: pgmap v229: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:31.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:31 smithi184 ceph-mon[35007]: pgmap v230: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:31 smithi122 ceph-mon[34247]: pgmap v230: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:31 smithi083 ceph-mon[30926]: pgmap v230: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:33.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:33 smithi184 ceph-mon[35007]: pgmap v231: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:33.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:33 smithi122 ceph-mon[34247]: pgmap v231: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:33.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:33 smithi083 ceph-mon[30926]: pgmap v231: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:35.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:35 smithi184 ceph-mon[35007]: pgmap v232: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:35.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:35 smithi122 ceph-mon[34247]: pgmap v232: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:35.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:35 smithi083 ceph-mon[30926]: pgmap v232: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:37.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:37 smithi184 ceph-mon[35007]: pgmap v233: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:37.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:37 smithi122 ceph-mon[34247]: pgmap v233: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:37.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:37 smithi083 ceph-mon[30926]: pgmap v233: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:39.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:39 smithi184 ceph-mon[35007]: pgmap v234: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:39.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:39 smithi083 ceph-mon[30926]: pgmap v234: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:39.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:39 smithi122 ceph-mon[34247]: pgmap v234: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:41.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:41 smithi184 ceph-mon[35007]: pgmap v235: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:41.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:41 smithi122 ceph-mon[34247]: pgmap v235: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:41.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:41 smithi083 ceph-mon[30926]: pgmap v235: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 19 op/s 2024-09-19T09:10:43.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:43 smithi184 ceph-mon[35007]: pgmap v236: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:43.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:43 smithi122 ceph-mon[34247]: pgmap v236: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:43.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:43 smithi083 ceph-mon[30926]: pgmap v236: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:45.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:45 smithi184 ceph-mon[35007]: pgmap v237: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:10:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:45 smithi122 ceph-mon[34247]: pgmap v237: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:10:45.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:45 smithi083 ceph-mon[30926]: pgmap v237: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 MiB/s wr, 19 op/s 2024-09-19T09:10:47.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:47 smithi184 ceph-mon[35007]: pgmap v238: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:47.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:47 smithi122 ceph-mon[34247]: pgmap v238: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:47.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:47 smithi083 ceph-mon[30926]: pgmap v238: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:10:49.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:49 smithi184 ceph-mon[35007]: pgmap v239: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:49 smithi122 ceph-mon[34247]: pgmap v239: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:49.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:49 smithi083 ceph-mon[30926]: pgmap v239: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:51.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:51 smithi184 ceph-mon[35007]: pgmap v240: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:51.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:51 smithi122 ceph-mon[34247]: pgmap v240: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:51.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:51 smithi083 ceph-mon[30926]: pgmap v240: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:53.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:53 smithi184 ceph-mon[35007]: pgmap v241: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 30 op/s 2024-09-19T09:10:53.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:53 smithi122 ceph-mon[34247]: pgmap v241: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 30 op/s 2024-09-19T09:10:53.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:53 smithi083 ceph-mon[30926]: pgmap v241: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 30 op/s 2024-09-19T09:10:55.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:55 smithi184 ceph-mon[35007]: pgmap v242: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:55.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:55 smithi122 ceph-mon[34247]: pgmap v242: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:55.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:55 smithi083 ceph-mon[30926]: pgmap v242: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:57.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:57 smithi184 ceph-mon[35007]: pgmap v243: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 37 MiB/s wr, 30 op/s 2024-09-19T09:10:57.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:57 smithi122 ceph-mon[34247]: pgmap v243: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 37 MiB/s wr, 30 op/s 2024-09-19T09:10:57.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:57 smithi083 ceph-mon[30926]: pgmap v243: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 37 MiB/s wr, 30 op/s 2024-09-19T09:10:59.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:10:59 smithi184 ceph-mon[35007]: pgmap v244: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:59.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:10:59 smithi122 ceph-mon[34247]: pgmap v244: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:10:59.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:10:59 smithi083 ceph-mon[30926]: pgmap v244: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:11:01.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:01 smithi184 ceph-mon[35007]: pgmap v245: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:11:01.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:01 smithi122 ceph-mon[34247]: pgmap v245: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:11:01.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:01 smithi083 ceph-mon[30926]: pgmap v245: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 20 op/s 2024-09-19T09:11:03.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:03 smithi184 ceph-mon[35007]: pgmap v246: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 47 op/s 2024-09-19T09:11:03.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:03 smithi122 ceph-mon[34247]: pgmap v246: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 47 op/s 2024-09-19T09:11:03.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:03 smithi083 ceph-mon[30926]: pgmap v246: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 47 op/s 2024-09-19T09:11:05.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:05 smithi184 ceph-mon[35007]: pgmap v247: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 37 op/s 2024-09-19T09:11:05.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:05 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:11:05.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:05 smithi122 ceph-mon[34247]: pgmap v247: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 37 op/s 2024-09-19T09:11:05.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:05 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:11:05.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:05 smithi083 ceph-mon[30926]: pgmap v247: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 37 op/s 2024-09-19T09:11:05.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:05 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:11:07.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:07 smithi184 ceph-mon[35007]: pgmap v248: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 38 MiB/s wr, 48 op/s 2024-09-19T09:11:07.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:07 smithi122 ceph-mon[34247]: pgmap v248: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 38 MiB/s wr, 48 op/s 2024-09-19T09:11:07.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:07 smithi083 ceph-mon[30926]: pgmap v248: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 38 MiB/s wr, 48 op/s 2024-09-19T09:11:09.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:09 smithi184 ceph-mon[35007]: pgmap v249: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 25 MiB/s wr, 38 op/s 2024-09-19T09:11:09.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:09 smithi184 ceph-mon[35007]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T09:11:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:09 smithi122 ceph-mon[34247]: pgmap v249: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 25 MiB/s wr, 38 op/s 2024-09-19T09:11:09.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:09 smithi122 ceph-mon[34247]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T09:11:09.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:09 smithi083 ceph-mon[30926]: pgmap v249: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 25 MiB/s wr, 38 op/s 2024-09-19T09:11:09.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:09 smithi083 ceph-mon[30926]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T09:11:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:11 smithi184 ceph-mon[35007]: pgmap v251: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 30 MiB/s wr, 46 op/s 2024-09-19T09:11:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:11 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:11 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:11 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:11.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:11 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:11:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:11 smithi122 ceph-mon[34247]: pgmap v251: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 30 MiB/s wr, 46 op/s 2024-09-19T09:11:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:11 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:11 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:11 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:11.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:11 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:11:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:11 smithi083 ceph-mon[30926]: pgmap v251: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 30 MiB/s wr, 46 op/s 2024-09-19T09:11:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:11 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:11 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:11 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:11.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:11 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:11:13.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:13 smithi184 ceph-mon[35007]: pgmap v252: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:11:13.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:13 smithi122 ceph-mon[34247]: pgmap v252: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:11:13.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:13 smithi083 ceph-mon[30926]: pgmap v252: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:11:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:15 smithi184 ceph-mon[35007]: pgmap v253: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:11:15.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:15 smithi184 ceph-mon[35007]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T09:11:15.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:15 smithi122 ceph-mon[34247]: pgmap v253: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:11:15.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:15 smithi122 ceph-mon[34247]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T09:11:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:15 smithi083 ceph-mon[30926]: pgmap v253: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 25 op/s 2024-09-19T09:11:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:15 smithi083 ceph-mon[30926]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T09:11:17.144 INFO:tasks.workunit.client.0.smithi083.stdout:fs setup took 418 secs 2024-09-19T09:11:17.652 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:17 smithi184 ceph-mon[35007]: pgmap v255: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:11:17.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:17 smithi122 ceph-mon[34247]: pgmap v255: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:11:17.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:17 smithi083 ceph-mon[30926]: pgmap v255: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 29 op/s 2024-09-19T09:11:18.159 INFO:tasks.workunit.client.0.smithi083.stdout:Syncing()...1 sec 2024-09-19T09:11:18.160 INFO:tasks.workunit.client.0.smithi083.stdout:Starting Actual Benchmark At: Thu Sep 19 09:11:18 2024 2024-09-19T09:11:18.160 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:11:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:19 smithi184 ceph-mon[35007]: pgmap v256: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-09-19T09:11:19.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:19 smithi122 ceph-mon[34247]: pgmap v256: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-09-19T09:11:19.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:19 smithi083 ceph-mon[30926]: pgmap v256: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-09-19T09:11:21.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:21 smithi184 ceph-mon[35007]: pgmap v257: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-09-19T09:11:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:21 smithi122 ceph-mon[34247]: pgmap v257: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-09-19T09:11:21.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:21 smithi083 ceph-mon[30926]: pgmap v257: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 MiB/s wr, 23 op/s 2024-09-19T09:11:23.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:23 smithi122 ceph-mon[34247]: pgmap v258: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 1.37k op/s 2024-09-19T09:11:23.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:23 smithi083 ceph-mon[30926]: pgmap v258: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 1.37k op/s 2024-09-19T09:11:23.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:23 smithi184 ceph-mon[35007]: pgmap v258: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 1.37k op/s 2024-09-19T09:11:25.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:25 smithi122 ceph-mon[34247]: pgmap v259: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 1.37k op/s 2024-09-19T09:11:25.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:25 smithi083 ceph-mon[30926]: pgmap v259: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 1.37k op/s 2024-09-19T09:11:25.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:25 smithi184 ceph-mon[35007]: pgmap v259: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 1.37k op/s 2024-09-19T09:11:27.701 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:27 smithi184 ceph-mon[35007]: pgmap v260: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 31 MiB/s wr, 3.54k op/s 2024-09-19T09:11:27.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:27 smithi122 ceph-mon[34247]: pgmap v260: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 31 MiB/s wr, 3.54k op/s 2024-09-19T09:11:27.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:27 smithi083 ceph-mon[30926]: pgmap v260: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 31 MiB/s wr, 3.54k op/s 2024-09-19T09:11:29.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:29 smithi122 ceph-mon[34247]: pgmap v261: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 3.19k op/s 2024-09-19T09:11:29.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:29 smithi083 ceph-mon[30926]: pgmap v261: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 3.19k op/s 2024-09-19T09:11:29.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:29 smithi184 ceph-mon[35007]: pgmap v261: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 3.19k op/s 2024-09-19T09:11:30.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:30 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:11:30.717 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:30 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:11:30.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:30 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:11:31.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:31 smithi122 ceph-mon[34247]: pgmap v262: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 3.19k op/s 2024-09-19T09:11:31.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:31 smithi083 ceph-mon[30926]: pgmap v262: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 3.19k op/s 2024-09-19T09:11:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:31 smithi184 ceph-mon[35007]: pgmap v262: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 3.19k op/s 2024-09-19T09:11:33.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:33 smithi122 ceph-mon[34247]: pgmap v263: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 5.16k op/s 2024-09-19T09:11:33.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:33 smithi083 ceph-mon[30926]: pgmap v263: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 5.16k op/s 2024-09-19T09:11:33.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:33 smithi184 ceph-mon[35007]: pgmap v263: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 5.16k op/s 2024-09-19T09:11:35.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:35 smithi122 ceph-mon[34247]: pgmap v264: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-09-19T09:11:35.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:35 smithi083 ceph-mon[30926]: pgmap v264: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-09-19T09:11:35.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:35 smithi184 ceph-mon[35007]: pgmap v264: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 4.03k op/s 2024-09-19T09:11:37.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:37 smithi184 ceph-mon[35007]: pgmap v265: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-09-19T09:11:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:37 smithi122 ceph-mon[34247]: pgmap v265: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-09-19T09:11:37.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:37 smithi083 ceph-mon[30926]: pgmap v265: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 5.93k op/s 2024-09-19T09:11:39.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:39 smithi184 ceph-mon[35007]: pgmap v266: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2024-09-19T09:11:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:39 smithi122 ceph-mon[34247]: pgmap v266: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2024-09-19T09:11:39.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:39 smithi083 ceph-mon[30926]: pgmap v266: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2024-09-19T09:11:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:41 smithi184 ceph-mon[35007]: pgmap v267: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2024-09-19T09:11:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:41 smithi122 ceph-mon[34247]: pgmap v267: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2024-09-19T09:11:41.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:41 smithi083 ceph-mon[30926]: pgmap v267: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2024-09-19T09:11:43.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:43 smithi184 ceph-mon[35007]: pgmap v268: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.79k op/s 2024-09-19T09:11:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:43 smithi122 ceph-mon[34247]: pgmap v268: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.79k op/s 2024-09-19T09:11:43.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:43 smithi083 ceph-mon[30926]: pgmap v268: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.79k op/s 2024-09-19T09:11:45.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:45 smithi184 ceph-mon[35007]: pgmap v269: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.82k op/s 2024-09-19T09:11:45.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:45 smithi122 ceph-mon[34247]: pgmap v269: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.82k op/s 2024-09-19T09:11:45.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:45 smithi083 ceph-mon[30926]: pgmap v269: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.82k op/s 2024-09-19T09:11:47.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:47 smithi184 ceph-mon[35007]: pgmap v270: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.81k op/s 2024-09-19T09:11:47.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:47 smithi122 ceph-mon[34247]: pgmap v270: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.81k op/s 2024-09-19T09:11:47.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:47 smithi083 ceph-mon[30926]: pgmap v270: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.81k op/s 2024-09-19T09:11:49.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:49 smithi184 ceph-mon[35007]: pgmap v271: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-19T09:11:49.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:49 smithi122 ceph-mon[34247]: pgmap v271: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-19T09:11:49.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:49 smithi083 ceph-mon[30926]: pgmap v271: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-19T09:11:51.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:51 smithi184 ceph-mon[35007]: pgmap v272: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-19T09:11:51.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:51 smithi122 ceph-mon[34247]: pgmap v272: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-19T09:11:51.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:51 smithi083 ceph-mon[30926]: pgmap v272: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.91k op/s 2024-09-19T09:11:53.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:53 smithi184 ceph-mon[35007]: pgmap v273: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.84k op/s 2024-09-19T09:11:53.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:53 smithi122 ceph-mon[34247]: pgmap v273: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.84k op/s 2024-09-19T09:11:53.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:53 smithi083 ceph-mon[30926]: pgmap v273: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 5.84k op/s 2024-09-19T09:11:55.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:55 smithi184 ceph-mon[35007]: pgmap v274: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2024-09-19T09:11:55.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:55 smithi122 ceph-mon[34247]: pgmap v274: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2024-09-19T09:11:55.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:55 smithi083 ceph-mon[30926]: pgmap v274: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2024-09-19T09:11:57.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:57 smithi184 ceph-mon[35007]: pgmap v275: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 5.64k op/s 2024-09-19T09:11:57.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:57 smithi122 ceph-mon[34247]: pgmap v275: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 5.64k op/s 2024-09-19T09:11:57.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:57 smithi083 ceph-mon[30926]: pgmap v275: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 5.64k op/s 2024-09-19T09:11:59.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:11:59 smithi184 ceph-mon[35007]: pgmap v276: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.78k op/s 2024-09-19T09:11:59.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:11:59 smithi122 ceph-mon[34247]: pgmap v276: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.78k op/s 2024-09-19T09:11:59.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:11:59 smithi083 ceph-mon[30926]: pgmap v276: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.78k op/s 2024-09-19T09:12:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:01 smithi184 ceph-mon[35007]: pgmap v277: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.78k op/s 2024-09-19T09:12:01.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:01 smithi122 ceph-mon[34247]: pgmap v277: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.78k op/s 2024-09-19T09:12:01.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:01 smithi083 ceph-mon[30926]: pgmap v277: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 3.78k op/s 2024-09-19T09:12:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:03 smithi184 ceph-mon[35007]: pgmap v278: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 22 MiB/s wr, 5.50k op/s 2024-09-19T09:12:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:03 smithi122 ceph-mon[34247]: pgmap v278: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 22 MiB/s wr, 5.50k op/s 2024-09-19T09:12:03.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:03 smithi083 ceph-mon[30926]: pgmap v278: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 22 MiB/s wr, 5.50k op/s 2024-09-19T09:12:05.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:05 smithi184 ceph-mon[35007]: pgmap v279: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 3.58k op/s 2024-09-19T09:12:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:05 smithi122 ceph-mon[34247]: pgmap v279: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 3.58k op/s 2024-09-19T09:12:05.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:05 smithi083 ceph-mon[30926]: pgmap v279: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 3.58k op/s 2024-09-19T09:12:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:06 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:12:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:06 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:12:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:06 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:12:07.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:07 smithi184 ceph-mon[35007]: pgmap v280: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2024-09-19T09:12:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:07 smithi122 ceph-mon[34247]: pgmap v280: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2024-09-19T09:12:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:07 smithi083 ceph-mon[30926]: pgmap v280: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2024-09-19T09:12:08.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:08 smithi184 ceph-mon[35007]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T09:12:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:08 smithi122 ceph-mon[34247]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T09:12:08.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:08 smithi083 ceph-mon[30926]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T09:12:09.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:09 smithi122 ceph-mon[34247]: pgmap v282: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-19T09:12:09.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:09 smithi083 ceph-mon[30926]: pgmap v282: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-19T09:12:10.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:09 smithi184 ceph-mon[35007]: pgmap v282: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-19T09:12:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:11 smithi122 ceph-mon[34247]: pgmap v283: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-19T09:12:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:11 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:12:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:11 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:11.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:11 smithi083 ceph-mon[30926]: pgmap v283: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-19T09:12:11.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:11 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:12:11.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:11 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:11 smithi184 ceph-mon[35007]: pgmap v283: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 4.16k op/s 2024-09-19T09:12:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:11 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:12:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:11 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:12.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:12 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:12.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:12 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:12.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:12 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:12:12.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:12 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:12.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:12 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:12.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:12 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:12:13.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:12 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:12 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:12 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:12:13.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:13 smithi122 ceph-mon[34247]: pgmap v284: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-19T09:12:13.971 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:13 smithi083 ceph-mon[30926]: pgmap v284: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-19T09:12:14.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:13 smithi184 ceph-mon[35007]: pgmap v284: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-19T09:12:15.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:15 smithi122 ceph-mon[34247]: pgmap v285: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-19T09:12:15.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:15 smithi122 ceph-mon[34247]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T09:12:15.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:15 smithi083 ceph-mon[30926]: pgmap v285: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-19T09:12:15.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:15 smithi083 ceph-mon[30926]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T09:12:16.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:15 smithi184 ceph-mon[35007]: pgmap v285: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2024-09-19T09:12:16.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:15 smithi184 ceph-mon[35007]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T09:12:17.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:17 smithi122 ceph-mon[34247]: pgmap v287: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2024-09-19T09:12:17.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:17 smithi083 ceph-mon[30926]: pgmap v287: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2024-09-19T09:12:18.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:17 smithi184 ceph-mon[35007]: pgmap v287: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2024-09-19T09:12:19.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:19 smithi122 ceph-mon[34247]: pgmap v288: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-09-19T09:12:19.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:19 smithi083 ceph-mon[30926]: pgmap v288: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-09-19T09:12:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:19 smithi184 ceph-mon[35007]: pgmap v288: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-09-19T09:12:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:21 smithi122 ceph-mon[34247]: pgmap v289: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-09-19T09:12:21.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:21 smithi083 ceph-mon[30926]: pgmap v289: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-09-19T09:12:22.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:21 smithi184 ceph-mon[35007]: pgmap v289: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2024-09-19T09:12:23.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:23 smithi122 ceph-mon[34247]: pgmap v290: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-19T09:12:23.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:23 smithi083 ceph-mon[30926]: pgmap v290: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-19T09:12:24.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:23 smithi184 ceph-mon[35007]: pgmap v290: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-19T09:12:26.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:25 smithi184 ceph-mon[35007]: pgmap v291: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-19T09:12:26.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:25 smithi122 ceph-mon[34247]: pgmap v291: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-19T09:12:26.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:25 smithi083 ceph-mon[30926]: pgmap v291: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 4.26k op/s 2024-09-19T09:12:28.012 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:27 smithi122 ceph-mon[34247]: pgmap v292: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 20 MiB/s wr, 5.17k op/s 2024-09-19T09:12:28.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:27 smithi184 ceph-mon[35007]: pgmap v292: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 20 MiB/s wr, 5.17k op/s 2024-09-19T09:12:28.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:27 smithi083 ceph-mon[30926]: pgmap v292: 129 pgs: 129 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 20 MiB/s wr, 5.17k op/s 2024-09-19T09:12:30.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:29 smithi184 ceph-mon[35007]: pgmap v293: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.82k op/s 2024-09-19T09:12:30.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:29 smithi122 ceph-mon[34247]: pgmap v293: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.82k op/s 2024-09-19T09:12:30.214 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:29 smithi083 ceph-mon[30926]: pgmap v293: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 3.82k op/s 2024-09-19T09:12:32.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:31 smithi184 ceph-mon[35007]: pgmap v294: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-19T09:12:32.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:31 smithi122 ceph-mon[34247]: pgmap v294: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-19T09:12:32.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:31 smithi083 ceph-mon[30926]: pgmap v294: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 3.31k op/s 2024-09-19T09:12:34.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:33 smithi184 ceph-mon[35007]: pgmap v295: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-19T09:12:34.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:33 smithi122 ceph-mon[34247]: pgmap v295: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-19T09:12:34.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:33 smithi083 ceph-mon[30926]: pgmap v295: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2024-09-19T09:12:36.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:35 smithi184 ceph-mon[35007]: pgmap v296: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-19T09:12:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:35 smithi122 ceph-mon[34247]: pgmap v296: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-19T09:12:36.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:35 smithi083 ceph-mon[30926]: pgmap v296: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.06k op/s 2024-09-19T09:12:38.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:37 smithi184 ceph-mon[35007]: pgmap v297: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 4.06k op/s 2024-09-19T09:12:38.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:37 smithi122 ceph-mon[34247]: pgmap v297: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 4.06k op/s 2024-09-19T09:12:38.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:37 smithi083 ceph-mon[30926]: pgmap v297: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 4.06k op/s 2024-09-19T09:12:40.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:39 smithi184 ceph-mon[35007]: pgmap v298: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:12:40.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:39 smithi122 ceph-mon[34247]: pgmap v298: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:12:40.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:39 smithi083 ceph-mon[30926]: pgmap v298: 129 pgs: 129 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:12:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:41 smithi184 ceph-mon[35007]: pgmap v299: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-09-19T09:12:42.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:41 smithi122 ceph-mon[34247]: pgmap v299: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-09-19T09:12:42.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:41 smithi083 ceph-mon[30926]: pgmap v299: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 2.86k op/s 2024-09-19T09:12:44.153 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:43 smithi184 ceph-mon[35007]: pgmap v300: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.86k op/s 2024-09-19T09:12:44.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:43 smithi122 ceph-mon[34247]: pgmap v300: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.86k op/s 2024-09-19T09:12:44.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:43 smithi083 ceph-mon[30926]: pgmap v300: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 3.86k op/s 2024-09-19T09:12:46.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:45 smithi184 ceph-mon[35007]: pgmap v301: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 MiB/s wr, 2.46k op/s 2024-09-19T09:12:46.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:45 smithi122 ceph-mon[34247]: pgmap v301: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 MiB/s wr, 2.46k op/s 2024-09-19T09:12:46.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:45 smithi083 ceph-mon[30926]: pgmap v301: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.7 MiB/s wr, 2.46k op/s 2024-09-19T09:12:48.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:47 smithi083 ceph-mon[30926]: pgmap v302: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.10k op/s 2024-09-19T09:12:48.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:47 smithi184 ceph-mon[35007]: pgmap v302: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.10k op/s 2024-09-19T09:12:48.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:47 smithi122 ceph-mon[34247]: pgmap v302: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.10k op/s 2024-09-19T09:12:50.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:49 smithi184 ceph-mon[35007]: pgmap v303: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 2.43k op/s 2024-09-19T09:12:50.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:49 smithi122 ceph-mon[34247]: pgmap v303: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 2.43k op/s 2024-09-19T09:12:50.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:49 smithi083 ceph-mon[30926]: pgmap v303: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 2.43k op/s 2024-09-19T09:12:52.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:51 smithi184 ceph-mon[35007]: pgmap v304: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 2.14k op/s 2024-09-19T09:12:52.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:51 smithi122 ceph-mon[34247]: pgmap v304: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 2.14k op/s 2024-09-19T09:12:52.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:51 smithi083 ceph-mon[30926]: pgmap v304: 129 pgs: 129 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 2.14k op/s 2024-09-19T09:12:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:53 smithi184 ceph-mon[35007]: pgmap v305: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-19T09:12:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:53 smithi122 ceph-mon[34247]: pgmap v305: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-19T09:12:54.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:53 smithi083 ceph-mon[30926]: pgmap v305: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-19T09:12:56.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:55 smithi184 ceph-mon[35007]: pgmap v306: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 2.26k op/s 2024-09-19T09:12:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:55 smithi122 ceph-mon[34247]: pgmap v306: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 2.26k op/s 2024-09-19T09:12:56.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:55 smithi083 ceph-mon[30926]: pgmap v306: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 2.26k op/s 2024-09-19T09:12:58.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:57 smithi184 ceph-mon[35007]: pgmap v307: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-19T09:12:58.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:57 smithi122 ceph-mon[34247]: pgmap v307: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-19T09:12:58.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:57 smithi083 ceph-mon[30926]: pgmap v307: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-19T09:13:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:12:59 smithi184 ceph-mon[35007]: pgmap v308: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-09-19T09:13:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:12:59 smithi122 ceph-mon[34247]: pgmap v308: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-09-19T09:13:00.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:12:59 smithi083 ceph-mon[30926]: pgmap v308: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 2.85k op/s 2024-09-19T09:13:02.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:01 smithi184 ceph-mon[35007]: pgmap v309: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-09-19T09:13:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:01 smithi122 ceph-mon[34247]: pgmap v309: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-09-19T09:13:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:01 smithi083 ceph-mon[30926]: pgmap v309: 129 pgs: 129 active+clean; 14 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-09-19T09:13:04.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:03 smithi184 ceph-mon[35007]: pgmap v310: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2024-09-19T09:13:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:03 smithi122 ceph-mon[34247]: pgmap v310: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2024-09-19T09:13:04.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:03 smithi083 ceph-mon[30926]: pgmap v310: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2024-09-19T09:13:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:05 smithi184 ceph-mon[35007]: pgmap v311: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 3.03k op/s 2024-09-19T09:13:06.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:05 smithi122 ceph-mon[34247]: pgmap v311: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 3.03k op/s 2024-09-19T09:13:06.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:05 smithi083 ceph-mon[30926]: pgmap v311: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 3.03k op/s 2024-09-19T09:13:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:07 smithi184 ceph-mon[35007]: pgmap v312: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-09-19T09:13:08.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:07 smithi122 ceph-mon[34247]: pgmap v312: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-09-19T09:13:08.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:07 smithi083 ceph-mon[30926]: pgmap v312: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2024-09-19T09:13:10.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:09 smithi184 ceph-mon[35007]: pgmap v313: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:13:10.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:09 smithi122 ceph-mon[34247]: pgmap v313: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:13:10.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:09 smithi083 ceph-mon[30926]: pgmap v313: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:13:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:11 smithi184 ceph-mon[35007]: pgmap v314: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 3.19k op/s 2024-09-19T09:13:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:11 smithi122 ceph-mon[34247]: pgmap v314: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 3.19k op/s 2024-09-19T09:13:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:11 smithi083 ceph-mon[30926]: pgmap v314: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 3.19k op/s 2024-09-19T09:13:13.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:12 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:13.155 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:12 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:13.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:12 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:13 smithi122 ceph-mon[34247]: pgmap v315: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2024-09-19T09:13:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:13 smithi122 ceph-mon[34247]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T09:13:14.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:13 smithi083 ceph-mon[30926]: pgmap v315: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2024-09-19T09:13:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:13 smithi083 ceph-mon[30926]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T09:13:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:13 smithi184 ceph-mon[35007]: pgmap v315: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2024-09-19T09:13:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:13 smithi184 ceph-mon[35007]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T09:13:15.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:15.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:15.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.401 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.402 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:15 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.409 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:15.409 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:15 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:15 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:16 smithi184 ceph-mon[35007]: pgmap v317: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 3.53k op/s 2024-09-19T09:13:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:16 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-09-19T09:13:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:16 smithi184 ceph-mon[35007]: Unable to set osd_memory_target on smithi122 to 184519372: error parsing value: Value '184519372' is below minimum 939524096 2024-09-19T09:13:16.405 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:16 smithi083 ceph-mon[30926]: pgmap v317: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 3.53k op/s 2024-09-19T09:13:16.405 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:16 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-09-19T09:13:16.405 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:16 smithi083 ceph-mon[30926]: Unable to set osd_memory_target on smithi122 to 184519372: error parsing value: Value '184519372' is below minimum 939524096 2024-09-19T09:13:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:16 smithi122 ceph-mon[34247]: pgmap v317: 129 pgs: 129 active+clean; 14 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 3.53k op/s 2024-09-19T09:13:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:16 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-09-19T09:13:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:16 smithi122 ceph-mon[34247]: Unable to set osd_memory_target on smithi122 to 184519372: error parsing value: Value '184519372' is below minimum 939524096 2024-09-19T09:13:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:18 smithi184 ceph-mon[35007]: pgmap v318: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 3.03k op/s 2024-09-19T09:13:18.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:18 smithi122 ceph-mon[34247]: pgmap v318: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 3.03k op/s 2024-09-19T09:13:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:18 smithi083 ceph-mon[30926]: pgmap v318: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 3.03k op/s 2024-09-19T09:13:20.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:20 smithi184 ceph-mon[35007]: pgmap v319: 129 pgs: 13 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 94 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:13:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:20 smithi122 ceph-mon[34247]: pgmap v319: 129 pgs: 13 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 94 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:13:20.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:20 smithi083 ceph-mon[30926]: pgmap v319: 129 pgs: 13 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 94 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:13:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: pgmap v320: 129 pgs: 13 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 94 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:13:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:21.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-19T09:13:21.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:21 smithi122 ceph-mon[34247]: Unable to set osd_memory_target on smithi184 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: pgmap v320: 129 pgs: 13 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 94 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-19T09:13:21.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:21 smithi083 ceph-mon[30926]: Unable to set osd_memory_target on smithi184 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T09:13:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: pgmap v320: 129 pgs: 13 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 94 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 3.26k op/s 2024-09-19T09:13:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:21.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:21.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:21.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-19T09:13:21.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:21 smithi184 ceph-mon[35007]: Unable to set osd_memory_target on smithi184 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T09:13:23.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:23 smithi122 ceph-mon[34247]: pgmap v321: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 2.13k op/s 2024-09-19T09:13:23.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:23 smithi083 ceph-mon[30926]: pgmap v321: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 2.13k op/s 2024-09-19T09:13:23.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:23 smithi184 ceph-mon[35007]: pgmap v321: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 2.13k op/s 2024-09-19T09:13:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:25 smithi184 ceph-mon[35007]: pgmap v322: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.7 MiB/s wr, 1.89k op/s 2024-09-19T09:13:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:25 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:25 smithi122 ceph-mon[34247]: pgmap v322: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.7 MiB/s wr, 1.89k op/s 2024-09-19T09:13:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:25 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:25.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:25 smithi083 ceph-mon[30926]: pgmap v322: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.7 MiB/s wr, 1.89k op/s 2024-09-19T09:13:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:25 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:27.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:27 smithi184 ceph-mon[35007]: pgmap v323: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.86k op/s 2024-09-19T09:13:27.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:27 smithi122 ceph-mon[34247]: pgmap v323: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.86k op/s 2024-09-19T09:13:27.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:27 smithi083 ceph-mon[30926]: pgmap v323: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.86k op/s 2024-09-19T09:13:29.763 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:29 smithi122 ceph-mon[34247]: pgmap v324: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 2.28k op/s 2024-09-19T09:13:29.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:29 smithi184 ceph-mon[35007]: pgmap v324: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 2.28k op/s 2024-09-19T09:13:29.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:29 smithi083 ceph-mon[30926]: pgmap v324: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 2.28k op/s 2024-09-19T09:13:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: pgmap v325: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 1.98k op/s 2024-09-19T09:13:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: Unable to set osd_memory_target on smithi083 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:31.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:31 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: pgmap v325: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 1.98k op/s 2024-09-19T09:13:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: Unable to set osd_memory_target on smithi083 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:31.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:31 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: pgmap v325: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 1.98k op/s 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:31.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-19T09:13:31.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: Unable to set osd_memory_target on smithi083 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T09:13:31.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:31.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:31.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:31 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:13:33.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:33 smithi184 ceph-mon[35007]: pgmap v326: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.6 MiB/s wr, 2.34k op/s 2024-09-19T09:13:33.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:33 smithi122 ceph-mon[34247]: pgmap v326: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.6 MiB/s wr, 2.34k op/s 2024-09-19T09:13:33.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:33 smithi083 ceph-mon[30926]: pgmap v326: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.6 MiB/s wr, 2.34k op/s 2024-09-19T09:13:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:35 smithi184 ceph-mon[35007]: pgmap v327: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 1.81k op/s 2024-09-19T09:13:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:35 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:35.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:35 smithi122 ceph-mon[34247]: pgmap v327: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 1.81k op/s 2024-09-19T09:13:35.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:35 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:35.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:35 smithi083 ceph-mon[30926]: pgmap v327: 129 pgs: 12 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 101 active+clean; 14 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 1.81k op/s 2024-09-19T09:13:35.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:35 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:37.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:37 smithi184 ceph-mon[35007]: pgmap v328: 129 pgs: 6 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 122 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 2.57k op/s 2024-09-19T09:13:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:37 smithi122 ceph-mon[34247]: pgmap v328: 129 pgs: 6 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 122 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 2.57k op/s 2024-09-19T09:13:37.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:37 smithi083 ceph-mon[30926]: pgmap v328: 129 pgs: 6 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 122 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 2.57k op/s 2024-09-19T09:13:39.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:39 smithi184 ceph-mon[35007]: pgmap v329: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 1.83k op/s 2024-09-19T09:13:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:39 smithi122 ceph-mon[34247]: pgmap v329: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 1.83k op/s 2024-09-19T09:13:39.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:39 smithi083 ceph-mon[30926]: pgmap v329: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 1.83k op/s 2024-09-19T09:13:41.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:41 smithi122 ceph-mon[34247]: pgmap v330: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 1.46k op/s 2024-09-19T09:13:41.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:41 smithi122 ceph-mon[34247]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T09:13:41.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:41 smithi083 ceph-mon[30926]: pgmap v330: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 1.46k op/s 2024-09-19T09:13:41.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:41 smithi083 ceph-mon[30926]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T09:13:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:41 smithi184 ceph-mon[35007]: pgmap v330: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 1.46k op/s 2024-09-19T09:13:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:41 smithi184 ceph-mon[35007]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T09:13:43.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:43 smithi122 ceph-mon[34247]: pgmap v332: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-19T09:13:43.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:43 smithi083 ceph-mon[30926]: pgmap v332: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-19T09:13:43.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:43 smithi184 ceph-mon[35007]: pgmap v332: 129 pgs: 3 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 125 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-19T09:13:45.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:45 smithi122 ceph-mon[34247]: pgmap v333: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-09-19T09:13:45.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:45 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:45.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:45 smithi122 ceph-mon[34247]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T09:13:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:45 smithi083 ceph-mon[30926]: pgmap v333: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-09-19T09:13:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:45 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:45 smithi083 ceph-mon[30926]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T09:13:45.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:45 smithi184 ceph-mon[35007]: pgmap v333: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 2.98k op/s 2024-09-19T09:13:45.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:45 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:13:45.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:45 smithi184 ceph-mon[35007]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T09:13:47.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:47 smithi122 ceph-mon[34247]: pgmap v335: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 2.96k op/s 2024-09-19T09:13:47.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:47 smithi083 ceph-mon[30926]: pgmap v335: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 2.96k op/s 2024-09-19T09:13:47.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:47 smithi184 ceph-mon[35007]: pgmap v335: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 2.96k op/s 2024-09-19T09:13:49.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:49 smithi122 ceph-mon[34247]: pgmap v336: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-09-19T09:13:49.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:49 smithi083 ceph-mon[30926]: pgmap v336: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-09-19T09:13:49.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:49 smithi184 ceph-mon[35007]: pgmap v336: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2024-09-19T09:13:51.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:51 smithi122 ceph-mon[34247]: pgmap v337: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-19T09:13:51.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:51 smithi083 ceph-mon[30926]: pgmap v337: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-19T09:13:51.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:51 smithi184 ceph-mon[35007]: pgmap v337: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 3.21k op/s 2024-09-19T09:13:53.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:53 smithi083 ceph-mon[30926]: pgmap v338: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:13:53.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:53 smithi184 ceph-mon[35007]: pgmap v338: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:13:53.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:53 smithi122 ceph-mon[34247]: pgmap v338: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:13:55.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:55 smithi184 ceph-mon[35007]: pgmap v339: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:13:55.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:55 smithi122 ceph-mon[34247]: pgmap v339: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:13:55.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:55 smithi083 ceph-mon[30926]: pgmap v339: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 14 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:13:57.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:57 smithi184 ceph-mon[35007]: pgmap v340: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-19T09:13:57.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:57 smithi122 ceph-mon[34247]: pgmap v340: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-19T09:13:57.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:57 smithi083 ceph-mon[30926]: pgmap v340: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 3.27k op/s 2024-09-19T09:13:59.761 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:13:59 smithi122 ceph-mon[34247]: pgmap v341: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-19T09:13:59.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:13:59 smithi184 ceph-mon[35007]: pgmap v341: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-19T09:13:59.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:13:59 smithi083 ceph-mon[30926]: pgmap v341: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-19T09:14:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:01 smithi184 ceph-mon[35007]: pgmap v342: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 2.29k op/s 2024-09-19T09:14:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:01 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:14:01.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:01 smithi122 ceph-mon[34247]: pgmap v342: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 2.29k op/s 2024-09-19T09:14:01.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:01 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:14:01.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:01 smithi083 ceph-mon[30926]: pgmap v342: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 2.29k op/s 2024-09-19T09:14:01.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:01 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:14:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:03 smithi184 ceph-mon[35007]: pgmap v343: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 3.43k op/s 2024-09-19T09:14:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:03 smithi122 ceph-mon[34247]: pgmap v343: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 3.43k op/s 2024-09-19T09:14:03.965 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:03 smithi083 ceph-mon[30926]: pgmap v343: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 3.43k op/s 2024-09-19T09:14:05.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:05 smithi184 ceph-mon[35007]: pgmap v344: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 2.52k op/s 2024-09-19T09:14:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:05 smithi122 ceph-mon[34247]: pgmap v344: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 2.52k op/s 2024-09-19T09:14:05.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:05 smithi083 ceph-mon[30926]: pgmap v344: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.9 MiB/s wr, 2.52k op/s 2024-09-19T09:14:07.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:07 smithi184 ceph-mon[35007]: pgmap v345: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.04k op/s 2024-09-19T09:14:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:07 smithi122 ceph-mon[34247]: pgmap v345: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.04k op/s 2024-09-19T09:14:07.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:07 smithi083 ceph-mon[30926]: pgmap v345: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 3.04k op/s 2024-09-19T09:14:09.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:09 smithi184 ceph-mon[35007]: pgmap v346: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-09-19T09:14:09.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:09 smithi122 ceph-mon[34247]: pgmap v346: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-09-19T09:14:09.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:09 smithi083 ceph-mon[30926]: pgmap v346: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.89k op/s 2024-09-19T09:14:11.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:11 smithi184 ceph-mon[35007]: pgmap v347: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 2.43k op/s 2024-09-19T09:14:11.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:11 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:14:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:11 smithi122 ceph-mon[34247]: pgmap v347: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 2.43k op/s 2024-09-19T09:14:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:11 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:14:11.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:11 smithi083 ceph-mon[30926]: pgmap v347: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 2.43k op/s 2024-09-19T09:14:11.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:11 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:14:13.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:13 smithi184 ceph-mon[35007]: pgmap v348: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:14:13.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:13 smithi122 ceph-mon[34247]: pgmap v348: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:14:13.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:13 smithi083 ceph-mon[30926]: pgmap v348: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:14:15.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:15 smithi184 ceph-mon[35007]: pgmap v349: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-09-19T09:14:15.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:15 smithi122 ceph-mon[34247]: pgmap v349: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-09-19T09:14:15.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:15 smithi083 ceph-mon[30926]: pgmap v349: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-09-19T09:14:17.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:17 smithi184 ceph-mon[35007]: pgmap v350: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.24k op/s 2024-09-19T09:14:17.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:17 smithi122 ceph-mon[34247]: pgmap v350: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.24k op/s 2024-09-19T09:14:17.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:17 smithi083 ceph-mon[30926]: pgmap v350: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 3.24k op/s 2024-09-19T09:14:18.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:18 smithi184 ceph-mon[35007]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T09:14:18.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:18 smithi122 ceph-mon[34247]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T09:14:18.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:18 smithi083 ceph-mon[30926]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T09:14:19.864 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:19 smithi083 ceph-mon[30926]: pgmap v352: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-09-19T09:14:19.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:19 smithi184 ceph-mon[35007]: pgmap v352: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-09-19T09:14:19.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:19 smithi122 ceph-mon[34247]: pgmap v352: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-09-19T09:14:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:21 smithi184 ceph-mon[35007]: pgmap v353: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 3.18k op/s 2024-09-19T09:14:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:21 smithi122 ceph-mon[34247]: pgmap v353: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 3.18k op/s 2024-09-19T09:14:21.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:21 smithi083 ceph-mon[30926]: pgmap v353: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 3.18k op/s 2024-09-19T09:14:23.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:23 smithi184 ceph-mon[35007]: pgmap v354: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-09-19T09:14:23.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:23 smithi122 ceph-mon[34247]: pgmap v354: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-09-19T09:14:23.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:23 smithi083 ceph-mon[30926]: pgmap v354: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 2.65k op/s 2024-09-19T09:14:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:25 smithi184 ceph-mon[35007]: pgmap v355: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-09-19T09:14:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:25 smithi184 ceph-mon[35007]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T09:14:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:25 smithi122 ceph-mon[34247]: pgmap v355: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-09-19T09:14:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:25 smithi122 ceph-mon[34247]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T09:14:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:25 smithi083 ceph-mon[30926]: pgmap v355: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-09-19T09:14:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:25 smithi083 ceph-mon[30926]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T09:14:27.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:27 smithi184 ceph-mon[35007]: pgmap v357: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 2.63k op/s 2024-09-19T09:14:27.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:27 smithi122 ceph-mon[34247]: pgmap v357: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 2.63k op/s 2024-09-19T09:14:27.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:27 smithi083 ceph-mon[30926]: pgmap v357: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 2.63k op/s 2024-09-19T09:14:29.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:29 smithi184 ceph-mon[35007]: pgmap v358: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 3.07k op/s 2024-09-19T09:14:29.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:29 smithi122 ceph-mon[34247]: pgmap v358: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 3.07k op/s 2024-09-19T09:14:29.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:29 smithi083 ceph-mon[30926]: pgmap v358: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 3.07k op/s 2024-09-19T09:14:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:31 smithi184 ceph-mon[35007]: pgmap v359: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-09-19T09:14:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:31 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:31 smithi122 ceph-mon[34247]: pgmap v359: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-09-19T09:14:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:31 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:31 smithi083 ceph-mon[30926]: pgmap v359: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 2.74k op/s 2024-09-19T09:14:31.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:31 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:33.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:32 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:33.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:32 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:33.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:32 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:33.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:32 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:33.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:32 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:33.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:32 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:34.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:33 smithi184 ceph-mon[35007]: pgmap v360: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.37k op/s 2024-09-19T09:14:34.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:33 smithi122 ceph-mon[34247]: pgmap v360: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.37k op/s 2024-09-19T09:14:34.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:33 smithi083 ceph-mon[30926]: pgmap v360: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.37k op/s 2024-09-19T09:14:36.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:35 smithi184 ceph-mon[35007]: pgmap v361: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.46k op/s 2024-09-19T09:14:36.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:35 smithi122 ceph-mon[34247]: pgmap v361: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.46k op/s 2024-09-19T09:14:36.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:35 smithi083 ceph-mon[30926]: pgmap v361: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 3.46k op/s 2024-09-19T09:14:38.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:37 smithi184 ceph-mon[35007]: pgmap v362: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.38k op/s 2024-09-19T09:14:38.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:37 smithi122 ceph-mon[34247]: pgmap v362: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.38k op/s 2024-09-19T09:14:38.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:37 smithi083 ceph-mon[30926]: pgmap v362: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 3.38k op/s 2024-09-19T09:14:39.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:39 smithi184 ceph-mon[35007]: pgmap v363: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 2.93k op/s 2024-09-19T09:14:39.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:39 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:39.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:39 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:39.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:39 smithi122 ceph-mon[34247]: pgmap v363: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 2.93k op/s 2024-09-19T09:14:39.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:39 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:39.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:39 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:39.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:39 smithi083 ceph-mon[30926]: pgmap v363: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 2.93k op/s 2024-09-19T09:14:39.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:39 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:39.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:39 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:40.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:40 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:40 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:40 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:40 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:40 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.712 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:40 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:40 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:40 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:40 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:14:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:41 smithi184 ceph-mon[35007]: pgmap v364: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 2.28k op/s 2024-09-19T09:14:42.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:41 smithi122 ceph-mon[34247]: pgmap v364: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 2.28k op/s 2024-09-19T09:14:42.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:41 smithi083 ceph-mon[30926]: pgmap v364: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 2.28k op/s 2024-09-19T09:14:44.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:43 smithi184 ceph-mon[35007]: pgmap v365: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 3.24k op/s 2024-09-19T09:14:44.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:43 smithi122 ceph-mon[34247]: pgmap v365: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 3.24k op/s 2024-09-19T09:14:44.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:43 smithi083 ceph-mon[30926]: pgmap v365: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 3.24k op/s 2024-09-19T09:14:46.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:45 smithi184 ceph-mon[35007]: pgmap v366: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 2.23k op/s 2024-09-19T09:14:46.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:45 smithi122 ceph-mon[34247]: pgmap v366: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 2.23k op/s 2024-09-19T09:14:46.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:45 smithi083 ceph-mon[30926]: pgmap v366: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 2.23k op/s 2024-09-19T09:14:48.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:47 smithi184 ceph-mon[35007]: pgmap v367: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 2.67k op/s 2024-09-19T09:14:48.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:47 smithi122 ceph-mon[34247]: pgmap v367: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 2.67k op/s 2024-09-19T09:14:48.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:47 smithi083 ceph-mon[30926]: pgmap v367: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 2.67k op/s 2024-09-19T09:14:50.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:49 smithi184 ceph-mon[35007]: pgmap v368: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-09-19T09:14:50.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:49 smithi122 ceph-mon[34247]: pgmap v368: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-09-19T09:14:50.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:49 smithi083 ceph-mon[30926]: pgmap v368: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 2.69k op/s 2024-09-19T09:14:52.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:51 smithi184 ceph-mon[35007]: pgmap v369: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 2.24k op/s 2024-09-19T09:14:52.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:51 smithi122 ceph-mon[34247]: pgmap v369: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 2.24k op/s 2024-09-19T09:14:52.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:51 smithi083 ceph-mon[30926]: pgmap v369: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 2.24k op/s 2024-09-19T09:14:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:53 smithi184 ceph-mon[35007]: pgmap v370: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 3.37k op/s 2024-09-19T09:14:54.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:53 smithi122 ceph-mon[34247]: pgmap v370: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 3.37k op/s 2024-09-19T09:14:54.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:53 smithi083 ceph-mon[30926]: pgmap v370: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 3.37k op/s 2024-09-19T09:14:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:55 smithi122 ceph-mon[34247]: pgmap v371: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-09-19T09:14:56.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:55 smithi083 ceph-mon[30926]: pgmap v371: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-09-19T09:14:56.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:55 smithi184 ceph-mon[35007]: pgmap v371: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-09-19T09:14:58.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:57 smithi184 ceph-mon[35007]: pgmap v372: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-19T09:14:58.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:57 smithi122 ceph-mon[34247]: pgmap v372: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-19T09:14:58.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:57 smithi083 ceph-mon[30926]: pgmap v372: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-19T09:15:00.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:14:59 smithi122 ceph-mon[34247]: pgmap v373: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 2.93k op/s 2024-09-19T09:15:00.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:14:59 smithi083 ceph-mon[30926]: pgmap v373: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 2.93k op/s 2024-09-19T09:15:00.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:14:59 smithi184 ceph-mon[35007]: pgmap v373: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 2.93k op/s 2024-09-19T09:15:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:01 smithi122 ceph-mon[34247]: pgmap v374: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 2.53k op/s 2024-09-19T09:15:02.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:01 smithi083 ceph-mon[30926]: pgmap v374: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 2.53k op/s 2024-09-19T09:15:02.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:01 smithi184 ceph-mon[35007]: pgmap v374: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 2.53k op/s 2024-09-19T09:15:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:03 smithi122 ceph-mon[34247]: pgmap v375: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:15:04.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:03 smithi083 ceph-mon[30926]: pgmap v375: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:15:04.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:03 smithi184 ceph-mon[35007]: pgmap v375: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 3.51k op/s 2024-09-19T09:15:06.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:05 smithi122 ceph-mon[34247]: pgmap v376: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-09-19T09:15:06.213 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:05 smithi083 ceph-mon[30926]: pgmap v376: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-09-19T09:15:06.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:05 smithi184 ceph-mon[35007]: pgmap v376: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 2.56k op/s 2024-09-19T09:15:08.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:07 smithi122 ceph-mon[34247]: pgmap v377: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-19T09:15:08.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:07 smithi083 ceph-mon[30926]: pgmap v377: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-19T09:15:08.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:07 smithi184 ceph-mon[35007]: pgmap v377: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-19T09:15:10.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:09 smithi122 ceph-mon[34247]: pgmap v378: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-19T09:15:10.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:09 smithi083 ceph-mon[30926]: pgmap v378: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-19T09:15:10.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:09 smithi184 ceph-mon[35007]: pgmap v378: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 2.81k op/s 2024-09-19T09:15:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:11 smithi122 ceph-mon[34247]: pgmap v379: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 2.40k op/s 2024-09-19T09:15:12.218 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:11 smithi083 ceph-mon[30926]: pgmap v379: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 2.40k op/s 2024-09-19T09:15:12.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:11 smithi184 ceph-mon[35007]: pgmap v379: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.5 MiB/s wr, 2.40k op/s 2024-09-19T09:15:14.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:13 smithi184 ceph-mon[35007]: pgmap v380: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-09-19T09:15:14.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:13 smithi122 ceph-mon[34247]: pgmap v380: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-09-19T09:15:14.464 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:13 smithi083 ceph-mon[30926]: pgmap v380: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 3.20k op/s 2024-09-19T09:15:16.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:15 smithi184 ceph-mon[35007]: pgmap v381: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 2.47k op/s 2024-09-19T09:15:16.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:15 smithi122 ceph-mon[34247]: pgmap v381: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 2.47k op/s 2024-09-19T09:15:16.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:15 smithi083 ceph-mon[30926]: pgmap v381: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.7 MiB/s wr, 2.47k op/s 2024-09-19T09:15:18.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:17 smithi184 ceph-mon[35007]: pgmap v382: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-09-19T09:15:18.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:17 smithi122 ceph-mon[34247]: pgmap v382: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-09-19T09:15:18.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:17 smithi083 ceph-mon[30926]: pgmap v382: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 2.58k op/s 2024-09-19T09:15:20.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:19 smithi083 ceph-mon[30926]: pgmap v383: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 3.17k op/s 2024-09-19T09:15:20.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:19 smithi184 ceph-mon[35007]: pgmap v383: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 3.17k op/s 2024-09-19T09:15:20.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:19 smithi122 ceph-mon[34247]: pgmap v383: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 3.17k op/s 2024-09-19T09:15:22.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:21 smithi184 ceph-mon[35007]: pgmap v384: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:22.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:21 smithi122 ceph-mon[34247]: pgmap v384: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:22.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:21 smithi083 ceph-mon[30926]: pgmap v384: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:24.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:23 smithi184 ceph-mon[35007]: pgmap v385: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 3.25k op/s 2024-09-19T09:15:24.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:23 smithi122 ceph-mon[34247]: pgmap v385: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 3.25k op/s 2024-09-19T09:15:24.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:23 smithi083 ceph-mon[30926]: pgmap v385: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 3.25k op/s 2024-09-19T09:15:26.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:25 smithi184 ceph-mon[35007]: pgmap v386: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:15:26.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:25 smithi122 ceph-mon[34247]: pgmap v386: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:15:26.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:25 smithi083 ceph-mon[30926]: pgmap v386: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 2.72k op/s 2024-09-19T09:15:28.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:27 smithi184 ceph-mon[35007]: pgmap v387: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-09-19T09:15:28.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:27 smithi122 ceph-mon[34247]: pgmap v387: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-09-19T09:15:28.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:27 smithi083 ceph-mon[30926]: pgmap v387: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 2.68k op/s 2024-09-19T09:15:30.262 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:29 smithi122 ceph-mon[34247]: pgmap v388: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 3.18k op/s 2024-09-19T09:15:30.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:29 smithi184 ceph-mon[35007]: pgmap v388: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 3.18k op/s 2024-09-19T09:15:30.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:29 smithi083 ceph-mon[30926]: pgmap v388: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 3.18k op/s 2024-09-19T09:15:32.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:32 smithi184 ceph-mon[35007]: pgmap v389: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 2.20k op/s 2024-09-19T09:15:32.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:32 smithi122 ceph-mon[34247]: pgmap v389: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 2.20k op/s 2024-09-19T09:15:32.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:32 smithi083 ceph-mon[30926]: pgmap v389: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 2.20k op/s 2024-09-19T09:15:34.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:34 smithi184 ceph-mon[35007]: pgmap v390: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-19T09:15:34.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:34 smithi122 ceph-mon[34247]: pgmap v390: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-19T09:15:34.465 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:34 smithi083 ceph-mon[30926]: pgmap v390: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 3.08k op/s 2024-09-19T09:15:36.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:36 smithi184 ceph-mon[35007]: pgmap v391: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-09-19T09:15:36.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:36 smithi122 ceph-mon[34247]: pgmap v391: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-09-19T09:15:36.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:36 smithi083 ceph-mon[30926]: pgmap v391: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 2.61k op/s 2024-09-19T09:15:38.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:38 smithi184 ceph-mon[35007]: pgmap v392: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-09-19T09:15:38.461 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:38 smithi122 ceph-mon[34247]: pgmap v392: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-09-19T09:15:38.462 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:38 smithi083 ceph-mon[30926]: pgmap v392: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.7 MiB/s wr, 2.45k op/s 2024-09-19T09:15:39.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:39 smithi184 ceph-mon[35007]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T09:15:40.959 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:40 smithi184 ceph-mon[35007]: pgmap v394: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-19T09:15:40.959 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:40 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:40.959 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:39 smithi083 ceph-mon[30926]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T09:15:40.959 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:40 smithi083 ceph-mon[30926]: pgmap v394: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-19T09:15:40.960 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:40 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:40.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:39 smithi122 ceph-mon[34247]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T09:15:40.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:40 smithi122 ceph-mon[34247]: pgmap v394: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 2.88k op/s 2024-09-19T09:15:40.960 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:40 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:41 smithi122 ceph-mon[34247]: pgmap v395: 129 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 123 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-19T09:15:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:41 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:41 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:41 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:41 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:41 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:41 smithi083 ceph-mon[30926]: pgmap v395: 129 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 123 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:41 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:41 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:41 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:41 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:41 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:41 smithi184 ceph-mon[35007]: pgmap v395: 129 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 123 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 2.92k op/s 2024-09-19T09:15:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:41 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:41 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:41 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:41 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:42.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:41 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:15:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:43 smithi122 ceph-mon[34247]: pgmap v396: 129 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 95 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 2.51k op/s 2024-09-19T09:15:43.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:43 smithi083 ceph-mon[30926]: pgmap v396: 129 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 95 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 2.51k op/s 2024-09-19T09:15:44.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:43 smithi184 ceph-mon[35007]: pgmap v396: 129 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 95 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 2.51k op/s 2024-09-19T09:15:45.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:45 smithi122 ceph-mon[34247]: pgmap v397: 129 pgs: 22 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 93 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:45.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:45 smithi083 ceph-mon[30926]: pgmap v397: 129 pgs: 22 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 93 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:46.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:45 smithi184 ceph-mon[35007]: pgmap v397: 129 pgs: 22 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 93 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:47.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:47 smithi122 ceph-mon[34247]: pgmap v398: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:47.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:47 smithi083 ceph-mon[30926]: pgmap v398: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:48.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:47 smithi184 ceph-mon[35007]: pgmap v398: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 2.44k op/s 2024-09-19T09:15:49.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:49 smithi122 ceph-mon[34247]: pgmap v399: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.1 MiB/s wr, 2.05k op/s 2024-09-19T09:15:49.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:49 smithi083 ceph-mon[30926]: pgmap v399: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.1 MiB/s wr, 2.05k op/s 2024-09-19T09:15:50.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:49 smithi184 ceph-mon[35007]: pgmap v399: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.1 MiB/s wr, 2.05k op/s 2024-09-19T09:15:51.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:51 smithi122 ceph-mon[34247]: pgmap v400: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 1.82k op/s 2024-09-19T09:15:51.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:51 smithi083 ceph-mon[30926]: pgmap v400: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 1.82k op/s 2024-09-19T09:15:52.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:51 smithi184 ceph-mon[35007]: pgmap v400: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 1.82k op/s 2024-09-19T09:15:53.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:53 smithi122 ceph-mon[34247]: pgmap v401: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-09-19T09:15:54.307 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:53 smithi184 ceph-mon[35007]: pgmap v401: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-09-19T09:15:54.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:53 smithi083 ceph-mon[30926]: pgmap v401: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 2.54k op/s 2024-09-19T09:15:56.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:55 smithi184 ceph-mon[35007]: pgmap v402: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 2.28k op/s 2024-09-19T09:15:56.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:55 smithi184 ceph-mon[35007]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T09:15:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:55 smithi122 ceph-mon[34247]: pgmap v402: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 2.28k op/s 2024-09-19T09:15:56.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:55 smithi122 ceph-mon[34247]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T09:15:56.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:55 smithi083 ceph-mon[30926]: pgmap v402: 129 pgs: 22 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 94 active+clean; 16 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 2.28k op/s 2024-09-19T09:15:56.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:55 smithi083 ceph-mon[30926]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T09:15:58.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:57 smithi184 ceph-mon[35007]: pgmap v404: 129 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 95 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 2.37k op/s 2024-09-19T09:15:58.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:57 smithi122 ceph-mon[34247]: pgmap v404: 129 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 95 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 2.37k op/s 2024-09-19T09:15:58.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:57 smithi083 ceph-mon[30926]: pgmap v404: 129 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 95 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 25 KiB/s rd, 9.3 MiB/s wr, 2.37k op/s 2024-09-19T09:16:00.013 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:15:59 smithi122 ceph-mon[34247]: pgmap v405: 129 pgs: 16 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 102 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 2.49k op/s 2024-09-19T09:16:00.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:15:59 smithi184 ceph-mon[35007]: pgmap v405: 129 pgs: 16 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 102 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 2.49k op/s 2024-09-19T09:16:00.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:15:59 smithi083 ceph-mon[30926]: pgmap v405: 129 pgs: 16 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 102 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.8 MiB/s wr, 2.49k op/s 2024-09-19T09:16:01.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:01 smithi083 ceph-mon[30926]: pgmap v406: 129 pgs: 16 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 102 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 2.41k op/s 2024-09-19T09:16:02.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:01 smithi184 ceph-mon[35007]: pgmap v406: 129 pgs: 16 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 102 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 2.41k op/s 2024-09-19T09:16:02.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:01 smithi122 ceph-mon[34247]: pgmap v406: 129 pgs: 16 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 102 active+clean; 16 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 2.41k op/s 2024-09-19T09:16:04.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:03 smithi184 ceph-mon[35007]: pgmap v407: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 2.37k op/s 2024-09-19T09:16:04.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:03 smithi122 ceph-mon[34247]: pgmap v407: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 2.37k op/s 2024-09-19T09:16:04.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:03 smithi083 ceph-mon[30926]: pgmap v407: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 2.37k op/s 2024-09-19T09:16:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:05 smithi184 ceph-mon[35007]: pgmap v408: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 2.40k op/s 2024-09-19T09:16:06.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:05 smithi122 ceph-mon[34247]: pgmap v408: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 2.40k op/s 2024-09-19T09:16:06.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:05 smithi083 ceph-mon[30926]: pgmap v408: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.5 MiB/s wr, 2.40k op/s 2024-09-19T09:16:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:07 smithi184 ceph-mon[35007]: pgmap v409: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 2.36k op/s 2024-09-19T09:16:08.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:07 smithi122 ceph-mon[34247]: pgmap v409: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 2.36k op/s 2024-09-19T09:16:08.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:07 smithi083 ceph-mon[30926]: pgmap v409: 129 pgs: 15 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 103 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 2.36k op/s 2024-09-19T09:16:10.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:09 smithi184 ceph-mon[35007]: pgmap v410: 129 pgs: 7 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 112 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.96k op/s 2024-09-19T09:16:10.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:09 smithi122 ceph-mon[34247]: pgmap v410: 129 pgs: 7 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 112 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.96k op/s 2024-09-19T09:16:10.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:09 smithi083 ceph-mon[30926]: pgmap v410: 129 pgs: 7 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 112 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.96k op/s 2024-09-19T09:16:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:11 smithi184 ceph-mon[35007]: pgmap v411: 129 pgs: 7 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 112 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 2.15k op/s 2024-09-19T09:16:12.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:11 smithi122 ceph-mon[34247]: pgmap v411: 129 pgs: 7 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 112 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 2.15k op/s 2024-09-19T09:16:12.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:11 smithi083 ceph-mon[30926]: pgmap v411: 129 pgs: 7 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 112 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 2.15k op/s 2024-09-19T09:16:14.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:13 smithi184 ceph-mon[35007]: pgmap v412: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-19T09:16:14.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:13 smithi122 ceph-mon[34247]: pgmap v412: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-19T09:16:14.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:13 smithi083 ceph-mon[30926]: pgmap v412: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 50 GiB used, 1022 GiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 2.92k op/s 2024-09-19T09:16:16.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:15 smithi184 ceph-mon[35007]: pgmap v413: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 26 KiB/s rd, 9.6 MiB/s wr, 2.42k op/s 2024-09-19T09:16:16.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:15 smithi122 ceph-mon[34247]: pgmap v413: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 26 KiB/s rd, 9.6 MiB/s wr, 2.42k op/s 2024-09-19T09:16:16.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:15 smithi083 ceph-mon[30926]: pgmap v413: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 26 KiB/s rd, 9.6 MiB/s wr, 2.42k op/s 2024-09-19T09:16:18.151 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:17 smithi184 ceph-mon[35007]: pgmap v414: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-09-19T09:16:18.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:17 smithi122 ceph-mon[34247]: pgmap v414: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-09-19T09:16:18.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:17 smithi083 ceph-mon[30926]: pgmap v414: 129 pgs: 6 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 114 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 2.13k op/s 2024-09-19T09:16:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:19 smithi184 ceph-mon[35007]: pgmap v415: 129 pgs: 5 active+clean+snaptrim, 124 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 3.10k op/s 2024-09-19T09:16:20.211 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:19 smithi122 ceph-mon[34247]: pgmap v415: 129 pgs: 5 active+clean+snaptrim, 124 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 3.10k op/s 2024-09-19T09:16:20.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:19 smithi083 ceph-mon[30926]: pgmap v415: 129 pgs: 5 active+clean+snaptrim, 124 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 3.10k op/s 2024-09-19T09:16:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:21 smithi184 ceph-mon[35007]: pgmap v416: 129 pgs: 5 active+clean+snaptrim, 124 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 33 KiB/s rd, 8.4 MiB/s wr, 2.10k op/s 2024-09-19T09:16:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:21 smithi184 ceph-mon[35007]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T09:16:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:21 smithi122 ceph-mon[34247]: pgmap v416: 129 pgs: 5 active+clean+snaptrim, 124 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 33 KiB/s rd, 8.4 MiB/s wr, 2.10k op/s 2024-09-19T09:16:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:21 smithi122 ceph-mon[34247]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T09:16:21.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:21 smithi083 ceph-mon[30926]: pgmap v416: 129 pgs: 5 active+clean+snaptrim, 124 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 33 KiB/s rd, 8.4 MiB/s wr, 2.10k op/s 2024-09-19T09:16:21.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:21 smithi083 ceph-mon[30926]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T09:16:22.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:22 smithi184 ceph-mon[35007]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T09:16:22.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:22 smithi122 ceph-mon[34247]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T09:16:22.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:22 smithi083 ceph-mon[30926]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T09:16:23.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:23 smithi184 ceph-mon[35007]: pgmap v419: 129 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 120 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 2.39k op/s 2024-09-19T09:16:23.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:23 smithi122 ceph-mon[34247]: pgmap v419: 129 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 120 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 2.39k op/s 2024-09-19T09:16:23.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:23 smithi083 ceph-mon[30926]: pgmap v419: 129 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 120 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 2.39k op/s 2024-09-19T09:16:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:25 smithi184 ceph-mon[35007]: pgmap v420: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.15k op/s 2024-09-19T09:16:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:25 smithi122 ceph-mon[34247]: pgmap v420: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.15k op/s 2024-09-19T09:16:25.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:25 smithi083 ceph-mon[30926]: pgmap v420: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 16 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 3.15k op/s 2024-09-19T09:16:27.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:27 smithi184 ceph-mon[35007]: pgmap v421: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 16 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 21 KiB/s rd, 6.4 MiB/s wr, 1.58k op/s 2024-09-19T09:16:27.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:27 smithi122 ceph-mon[34247]: pgmap v421: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 16 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 21 KiB/s rd, 6.4 MiB/s wr, 1.58k op/s 2024-09-19T09:16:27.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:27 smithi083 ceph-mon[30926]: pgmap v421: 129 pgs: 34 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 83 active+clean; 16 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 21 KiB/s rd, 6.4 MiB/s wr, 1.58k op/s 2024-09-19T09:16:29.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:29 smithi184 ceph-mon[35007]: pgmap v422: 129 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 111 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 2.44k op/s 2024-09-19T09:16:29.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:29 smithi122 ceph-mon[34247]: pgmap v422: 129 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 111 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 2.44k op/s 2024-09-19T09:16:29.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:29 smithi083 ceph-mon[30926]: pgmap v422: 129 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 111 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 2.44k op/s 2024-09-19T09:16:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:31 smithi184 ceph-mon[35007]: pgmap v423: 129 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 111 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 1.98k op/s 2024-09-19T09:16:31.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:31 smithi122 ceph-mon[34247]: pgmap v423: 129 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 111 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 1.98k op/s 2024-09-19T09:16:31.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:31 smithi083 ceph-mon[30926]: pgmap v423: 129 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 111 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 1.98k op/s 2024-09-19T09:16:33.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:33 smithi184 ceph-mon[35007]: pgmap v424: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 9.0 MiB/s wr, 2.24k op/s 2024-09-19T09:16:33.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:33 smithi122 ceph-mon[34247]: pgmap v424: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 9.0 MiB/s wr, 2.24k op/s 2024-09-19T09:16:33.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:33 smithi083 ceph-mon[30926]: pgmap v424: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 9.0 MiB/s wr, 2.24k op/s 2024-09-19T09:16:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:35 smithi184 ceph-mon[35007]: pgmap v425: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 32 KiB/s rd, 9.3 MiB/s wr, 2.31k op/s 2024-09-19T09:16:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:35 smithi184 ceph-mon[35007]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T09:16:35.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:35 smithi122 ceph-mon[34247]: pgmap v425: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 32 KiB/s rd, 9.3 MiB/s wr, 2.31k op/s 2024-09-19T09:16:35.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:35 smithi122 ceph-mon[34247]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T09:16:35.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:35 smithi083 ceph-mon[30926]: pgmap v425: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 32 KiB/s rd, 9.3 MiB/s wr, 2.31k op/s 2024-09-19T09:16:35.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:35 smithi083 ceph-mon[30926]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T09:16:37.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:37 smithi184 ceph-mon[35007]: pgmap v427: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 33 KiB/s rd, 8.4 MiB/s wr, 2.09k op/s 2024-09-19T09:16:37.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:37 smithi122 ceph-mon[34247]: pgmap v427: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 33 KiB/s rd, 8.4 MiB/s wr, 2.09k op/s 2024-09-19T09:16:37.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:37 smithi083 ceph-mon[30926]: pgmap v427: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 33 KiB/s rd, 8.4 MiB/s wr, 2.09k op/s 2024-09-19T09:16:39.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:39 smithi184 ceph-mon[35007]: pgmap v428: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-09-19T09:16:39.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:39 smithi122 ceph-mon[34247]: pgmap v428: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-09-19T09:16:39.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:39 smithi083 ceph-mon[30926]: pgmap v428: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-09-19T09:16:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:41 smithi184 ceph-mon[35007]: pgmap v429: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-09-19T09:16:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:41 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:41 smithi122 ceph-mon[34247]: pgmap v429: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-09-19T09:16:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:41 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:41 smithi083 ceph-mon[30926]: pgmap v429: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 1.49k op/s 2024-09-19T09:16:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:41 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:42.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:42 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:42.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:42 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:42 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:42.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:42 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:42 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:42.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:42 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:43.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:43 smithi184 ceph-mon[35007]: pgmap v430: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 33 KiB/s rd, 3.0 MiB/s wr, 749 op/s 2024-09-19T09:16:43.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:43 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:16:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:43 smithi122 ceph-mon[34247]: pgmap v430: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 33 KiB/s rd, 3.0 MiB/s wr, 749 op/s 2024-09-19T09:16:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:43 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:16:43.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:43 smithi083 ceph-mon[30926]: pgmap v430: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 33 KiB/s rd, 3.0 MiB/s wr, 749 op/s 2024-09-19T09:16:43.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:43 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:16:45.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:45 smithi184 ceph-mon[35007]: pgmap v431: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 28 KiB/s rd, 737 KiB/s wr, 196 op/s 2024-09-19T09:16:45.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:45 smithi122 ceph-mon[34247]: pgmap v431: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 28 KiB/s rd, 737 KiB/s wr, 196 op/s 2024-09-19T09:16:45.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:45 smithi083 ceph-mon[30926]: pgmap v431: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 28 KiB/s rd, 737 KiB/s wr, 196 op/s 2024-09-19T09:16:47.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:47 smithi184 ceph-mon[35007]: pgmap v432: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 27 KiB/s rd, 702 KiB/s wr, 188 op/s 2024-09-19T09:16:47.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:47 smithi122 ceph-mon[34247]: pgmap v432: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 27 KiB/s rd, 702 KiB/s wr, 188 op/s 2024-09-19T09:16:47.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:47 smithi083 ceph-mon[30926]: pgmap v432: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 27 KiB/s rd, 702 KiB/s wr, 188 op/s 2024-09-19T09:16:49.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:49 smithi184 ceph-mon[35007]: pgmap v433: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 780 KiB/s wr, 208 op/s 2024-09-19T09:16:49.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:49 smithi122 ceph-mon[34247]: pgmap v433: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 780 KiB/s wr, 208 op/s 2024-09-19T09:16:49.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:49 smithi083 ceph-mon[30926]: pgmap v433: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 25 KiB/s rd, 780 KiB/s wr, 208 op/s 2024-09-19T09:16:51.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:51 smithi184 ceph-mon[35007]: pgmap v434: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 16 KiB/s rd, 508 KiB/s wr, 135 op/s 2024-09-19T09:16:51.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:51 smithi122 ceph-mon[34247]: pgmap v434: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 16 KiB/s rd, 508 KiB/s wr, 135 op/s 2024-09-19T09:16:51.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:51 smithi083 ceph-mon[30926]: pgmap v434: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 16 KiB/s rd, 508 KiB/s wr, 135 op/s 2024-09-19T09:16:53.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:53 smithi184 ceph-mon[35007]: pgmap v435: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 22 KiB/s rd, 512 KiB/s wr, 138 op/s 2024-09-19T09:16:53.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:53 smithi122 ceph-mon[34247]: pgmap v435: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 22 KiB/s rd, 512 KiB/s wr, 138 op/s 2024-09-19T09:16:53.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:53 smithi083 ceph-mon[30926]: pgmap v435: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 22 KiB/s rd, 512 KiB/s wr, 138 op/s 2024-09-19T09:16:55.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:55 smithi184 ceph-mon[35007]: pgmap v436: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 15 KiB/s rd, 315 KiB/s wr, 87 op/s 2024-09-19T09:16:55.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:55 smithi122 ceph-mon[34247]: pgmap v436: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 15 KiB/s rd, 315 KiB/s wr, 87 op/s 2024-09-19T09:16:55.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:55 smithi083 ceph-mon[30926]: pgmap v436: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 15 KiB/s rd, 315 KiB/s wr, 87 op/s 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout:Syncing()...11 sec 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout:FFSB benchmark finished at: Thu Sep 19 09:16:56 2024 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout:Results: 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout:Benchmark took 338.73 sec 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout:Total Results 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout:=============== 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-19T09:16:56.893 INFO:tasks.workunit.client.0.smithi083.stdout: ======= ============ ========= ======= =========== ========== 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout: write : 997120 2943.67 100.000% 100.000% 11.5MB/sec 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout:- 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout:2943.67 Transactions per Second 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout:Throughput Results 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout:=================== 2024-09-19T09:16:56.894 INFO:tasks.workunit.client.0.smithi083.stdout:Write Throughput: 11.5MB/sec 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout:System Call Latency statistics in millisecs 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout:===== 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout: Min Avg Max Total Calls 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout: ======== ======== ======== ============ 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout:[ open] 0.441000 517.953865 18041.828125 779 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[0] 5000.000000 - 10000.000000 : 17 2024-09-19T09:16:56.898 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[1] 2000.000000 - 5000.000000 : 5 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[2] 1000.000000 - 2000.000000 : 2 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[3] 500.000000 - 1000.000000 : 2 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[5] 100.000000 - 200.000000 : 16 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[6] 50.000000 - 100.000000 : 94 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[7] 20.000000 - 50.000000 : 236 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[8] 10.000000 - 20.000000 : 162 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[9] 5.000000 - 10.000000 : 125 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[10] 2.000000 - 5.000000 : 76 2024-09-19T09:16:56.899 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[11] 1.000000 - 2.000000 : 20 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout:[ write] 0.079000 9.486256 40329.617188 997120 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[0] 5000.000000 - 10000.000000 : 32 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[1] 2000.000000 - 5000.000000 : 16 2024-09-19T09:16:56.900 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[2] 1000.000000 - 2000.000000 : 15 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[3] 500.000000 - 1000.000000 : 79 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[4] 200.000000 - 500.000000 : 1073 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[5] 100.000000 - 200.000000 : 3127 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[6] 50.000000 - 100.000000 : 12895 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[7] 20.000000 - 50.000000 : 63918 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[8] 10.000000 - 20.000000 : 92882 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[9] 5.000000 - 10.000000 : 106379 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[10] 2.000000 - 5.000000 : 118610 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[11] 1.000000 - 2.000000 : 58660 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[12] 0.500000 - 1.000000 : 52923 2024-09-19T09:16:56.901 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[13] 0.200000 - 0.500000 : 218697 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[14] 0.100000 - 0.200000 : 261825 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[15] 0.050000 - 0.100000 : 5874 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.902 INFO:tasks.workunit.client.0.smithi083.stdout:[ lseek] 0.000000 0.000860 3.559000 997120 2024-09-19T09:16:56.903 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:16:56.903 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:16:56.903 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:16:56.903 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:16:56.903 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:16:56.903 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:16:56.904 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T09:16:56.904 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-19T09:16:56.904 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-19T09:16:56.904 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-19T09:16:56.904 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-09-19T09:16:56.904 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[11] 1.000000 - 2.000000 : 4 2024-09-19T09:16:56.905 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[12] 0.500000 - 1.000000 : 4 2024-09-19T09:16:56.905 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[13] 0.200000 - 0.500000 : 8 2024-09-19T09:16:56.905 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[14] 0.100000 - 0.200000 : 10 2024-09-19T09:16:56.905 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[15] 0.050000 - 0.100000 : 10 2024-09-19T09:16:56.905 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[16] 0.020000 - 0.050000 : 153 2024-09-19T09:16:56.905 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[17] 0.010000 - 0.020000 : 745 2024-09-19T09:16:56.906 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[18] 0.000000 - 0.010000 : 996184 2024-09-19T09:16:56.906 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.906 INFO:tasks.workunit.client.0.smithi083.stdout:[ close] 0.018000 3.575917 796.984009 779 2024-09-19T09:16:56.906 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:16:56.906 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:16:56.906 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:16:56.907 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[3] 500.000000 - 1000.000000 : 1 2024-09-19T09:16:56.907 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:16:56.907 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2024-09-19T09:16:56.907 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[6] 50.000000 - 100.000000 : 4 2024-09-19T09:16:56.907 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[7] 20.000000 - 50.000000 : 17 2024-09-19T09:16:56.907 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[8] 10.000000 - 20.000000 : 27 2024-09-19T09:16:56.908 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[9] 5.000000 - 10.000000 : 32 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[10] 2.000000 - 5.000000 : 43 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[11] 1.000000 - 2.000000 : 38 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[12] 0.500000 - 1.000000 : 32 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[13] 0.200000 - 0.500000 : 46 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[14] 0.100000 - 0.200000 : 118 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[15] 0.050000 - 0.100000 : 73 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[16] 0.020000 - 0.050000 : 344 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[17] 0.010000 - 0.020000 : 2 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.909 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.910 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.910 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-19T09:16:56.910 INFO:tasks.workunit.client.0.smithi083.stdout:0.5% User Time 2024-09-19T09:16:56.910 INFO:tasks.workunit.client.0.smithi083.stdout:27.7% System Time 2024-09-19T09:16:56.910 INFO:tasks.workunit.client.0.smithi083.stdout:28.2% CPU Utilization 2024-09-19T09:16:56.912 INFO:tasks.workunit.client.0.smithi083.stderr:+ cd .. 2024-09-19T09:16:56.920 INFO:tasks.workunit.client.0.smithi083.stderr:+ rm -r tmp ffsb 2024-09-19T09:16:57.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:57 smithi184 ceph-mon[35007]: pgmap v437: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 11 KiB/s rd, 196 KiB/s wr, 58 op/s 2024-09-19T09:16:57.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:57 smithi122 ceph-mon[34247]: pgmap v437: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 11 KiB/s rd, 196 KiB/s wr, 58 op/s 2024-09-19T09:16:57.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:57 smithi083 ceph-mon[30926]: pgmap v437: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 11 KiB/s rd, 196 KiB/s wr, 58 op/s 2024-09-19T09:16:59.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:59 smithi184 ceph-mon[35007]: pgmap v438: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 11 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-09-19T09:16:59.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:16:59 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:16:59.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:59 smithi122 ceph-mon[34247]: pgmap v438: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 11 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-09-19T09:16:59.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:16:59 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:16:59.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:59 smithi083 ceph-mon[30926]: pgmap v438: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 11 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-09-19T09:16:59.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:16:59 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:00.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:00 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:00.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:00 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:00.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:00 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:01.862 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:01 smithi122 ceph-mon[34247]: pgmap v439: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T09:17:01.862 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:01 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:01 smithi184 ceph-mon[35007]: pgmap v439: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T09:17:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:01 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:01.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:01 smithi083 ceph-mon[30926]: pgmap v439: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T09:17:01.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:01 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:02.432 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:17:02.433 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:17:02.602 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-19T09:17:02.602 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:17:02.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:02 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:02.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:02 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:02.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:02 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:03.120 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:03.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:17:03.197 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:17:03.197 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T09:17:03.229 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T09:17:03.229 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:17:03.229 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:17:03.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T09:17:03.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T09:17:03.403 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T09:17:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.735+0000 7f296f59e640 1 -- 172.21.15.83:0/3779719169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968095520 msgr2=0x7f2968099170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.735+0000 7f296f59e640 1 --2- 172.21.15.83:0/3779719169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968095520 0x7f2968099170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2960009930 tx=0x7f296002a460 comp rx=0 tx=0).stop 2024-09-19T09:17:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.738+0000 7f296f59e640 1 -- 172.21.15.83:0/3779719169 shutdown_connections 2024-09-19T09:17:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.738+0000 7f296f59e640 1 --2- 172.21.15.83:0/3779719169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968099880 0x7f29680a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.738+0000 7f296f59e640 1 --2- 172.21.15.83:0/3779719169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968095520 0x7f2968099170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.738+0000 7f296f59e640 1 --2- 172.21.15.83:0/3779719169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2968094b70 0x7f2968094f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.738+0000 7f296f59e640 1 -- 172.21.15.83:0/3779719169 >> 172.21.15.83:0/3779719169 conn(0x7f296800b480 msgr2=0x7f296800b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.747+0000 7f296f59e640 1 -- 172.21.15.83:0/3779719169 shutdown_connections 2024-09-19T09:17:03.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.748+0000 7f296f59e640 1 -- 172.21.15.83:0/3779719169 wait complete. 2024-09-19T09:17:03.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.749+0000 7f296f59e640 1 Processor -- start 2024-09-19T09:17:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 -- start start 2024-09-19T09:17:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2968094b70 0x7f296812be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968099880 0x7f296812c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 0x7f2968130be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f29680a4870 con 0x7f2968094b70 2024-09-19T09:17:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29680a46f0 con 0x7f2968099880 2024-09-19T09:17:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.752+0000 7f296f59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f29680a49f0 con 0x7f2968130730 2024-09-19T09:17:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.753+0000 7f296ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 0x7f2968130be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.753+0000 7f296ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 0x7f2968130be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.83:49098/0 (socket says 172.21.15.83:49098) 2024-09-19T09:17:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.753+0000 7f296ed9d640 1 -- 172.21.15.83:0/2548312866 learned_addr learned my addr 172.21.15.83:0/2548312866 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.753+0000 7f296dd9b640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968099880 0x7f296812c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.757+0000 7f296ed9d640 1 -- 172.21.15.83:0/2548312866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968099880 msgr2=0x7f296812c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.757+0000 7f296ed9d640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968099880 0x7f296812c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.757+0000 7f296ed9d640 1 -- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2968094b70 msgr2=0x7f296812be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.757+0000 7f296ed9d640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2968094b70 0x7f296812be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.757+0000 7f296ed9d640 1 -- 172.21.15.83:0/2548312866 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968131220 con 0x7f2968130730 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.757+0000 7f296dd9b640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968099880 0x7f296812c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.758+0000 7f296ed9d640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 0x7f2968130be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2970051500 tx=0x7f297006e430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.760+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970082070 con 0x7f2968130730 2024-09-19T09:17:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.760+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2968131510 con 0x7f2968130730 2024-09-19T09:17:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.761+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296809b710 con 0x7f2968130730 2024-09-19T09:17:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.761+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2970075560 con 0x7f2968130730 2024-09-19T09:17:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.761+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297007d6c0 con 0x7f2968130730 2024-09-19T09:17:03.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.766+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29500052c0 con 0x7f2968130730 2024-09-19T09:17:03.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.771+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2970085070 con 0x7f2968130730 2024-09-19T09:17:03.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.772+0000 7f29677fe640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f295c0a35c0 0x7f295c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.772+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7f29701371e0 con 0x7f2968130730 2024-09-19T09:17:03.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.775+0000 7f296e59c640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f295c0a35c0 0x7f295c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.776+0000 7f296e59c640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f295c0a35c0 0x7f295c0a5a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2958009710 tx=0x7f2958006c80 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:03.780+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2970103880 con 0x7f2968130730 2024-09-19T09:17:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:03 smithi184 ceph-mon[35007]: pgmap v440: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 145 KiB/s rd, 162 KiB/s wr, 61 op/s 2024-09-19T09:17:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:03 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:03 smithi184 ceph-mon[35007]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T09:17:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:03 smithi122 ceph-mon[34247]: pgmap v440: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 145 KiB/s rd, 162 KiB/s wr, 61 op/s 2024-09-19T09:17:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:03 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:03 smithi122 ceph-mon[34247]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T09:17:03.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:03 smithi083 ceph-mon[30926]: pgmap v440: 129 pgs: 129 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 145 KiB/s rd, 162 KiB/s wr, 61 op/s 2024-09-19T09:17:03.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:03 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:03.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:03 smithi083 ceph-mon[30926]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T09:17:04.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.160+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 --> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2950000bf0 con 0x7f295c0a35c0 2024-09-19T09:17:04.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.217+0000 7f29677fe640 1 -- 172.21.15.83:0/2548312866 <== mgr.15288 v2:172.21.15.83:6800/2671255807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f2950000bf0 con 0x7f295c0a35c0 2024-09-19T09:17:04.218 INFO:teuthology.orchestra.run.smithi083.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T09:03:02", "first": "2024-09-19T09:04:00", "last": "2024-09-19T09:17:00", "last_pruned": "2024-09-19T09:17:01", "created_count": 14, "pruned_count": 8, "active": true} 2024-09-19T09:17:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.220+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f295c0a35c0 msgr2=0x7f295c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.220+0000 7f296f59e640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f295c0a35c0 0x7f295c0a5a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2958009710 tx=0x7f2958006c80 comp rx=0 tx=0).stop 2024-09-19T09:17:04.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.220+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 msgr2=0x7f2968130be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.220+0000 7f296f59e640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 0x7f2968130be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2970051500 tx=0x7f297006e430 comp rx=0 tx=0).stop 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 shutdown_connections 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f295c0a35c0 0x7f295c0a5a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2968130730 0x7f2968130be0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2968099880 0x7f296812c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 --2- 172.21.15.83:0/2548312866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2968094b70 0x7f296812be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 >> 172.21.15.83:0/2548312866 conn(0x7f296800b480 msgr2=0x7f2968093260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 shutdown_connections 2024-09-19T09:17:04.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.221+0000 7f296f59e640 1 -- 172.21.15.83:0/2548312866 wait complete. 2024-09-19T09:17:04.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T09:17:04.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.438+0000 7fb59ed6d640 1 -- 172.21.15.83:0/2899464402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981095d0 msgr2=0x7fb598109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.438+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/2899464402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981095d0 0x7fb598109a10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb580009900 tx=0x7fb58002a440 comp rx=0 tx=0).stop 2024-09-19T09:17:04.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.444+0000 7fb59ed6d640 1 -- 172.21.15.83:0/2899464402 shutdown_connections 2024-09-19T09:17:04.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.444+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/2899464402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb59811b140 0x7fb59811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.444+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/2899464402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981095d0 0x7fb598109a10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.444+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/2899464402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5981091f0 0x7fb598110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.444+0000 7fb59ed6d640 1 -- 172.21.15.83:0/2899464402 >> 172.21.15.83:0/2899464402 conn(0x7fb59806ce00 msgr2=0x7fb59806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.449+0000 7fb59ed6d640 1 -- 172.21.15.83:0/2899464402 shutdown_connections 2024-09-19T09:17:04.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.452+0000 7fb59ed6d640 1 -- 172.21.15.83:0/2899464402 wait complete. 2024-09-19T09:17:04.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.452+0000 7fb59ed6d640 1 Processor -- start 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.456+0000 7fb59ed6d640 1 -- start start 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.456+0000 7fb59ed6d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 0x7fb5981a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.456+0000 7fb59ed6d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5981095d0 0x7fb5981a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.456+0000 7fb59ed6d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb59811b140 0x7fb5981ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.457+0000 7fb59ed6d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb598120c00 con 0x7fb5981091f0 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.457+0000 7fb59ed6d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb598120a80 con 0x7fb59811b140 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.457+0000 7fb59ed6d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb598120d80 con 0x7fb5981095d0 2024-09-19T09:17:04.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 0x7fb5981a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 0x7fb5981a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46784/0 (socket says 172.21.15.83:46784) 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 -- 172.21.15.83:0/3481923050 learned_addr learned my addr 172.21.15.83:0/3481923050 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 -- 172.21.15.83:0/3481923050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5981095d0 msgr2=0x7fb5981a75c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5981095d0 0x7fb5981a75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 -- 172.21.15.83:0/3481923050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb59811b140 msgr2=0x7fb5981ab940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb59811b140 0x7fb5981ab940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.459+0000 7fb59cb09640 1 -- 172.21.15.83:0/3481923050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5981ac040 con 0x7fb5981091f0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.460+0000 7fb59cb09640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 0x7fb5981a7080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b450 tx=0x7fb59000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.460+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590015020 con 0x7fb5981091f0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.460+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5981ac330 con 0x7fb5981091f0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.461+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb598110920 con 0x7fb5981091f0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.461+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb590011d40 con 0x7fb5981091f0 2024-09-19T09:17:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.461+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59000f340 con 0x7fb5981091f0 2024-09-19T09:17:04.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.463+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578005290 con 0x7fb5981091f0 2024-09-19T09:17:04.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.464+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb590018020 con 0x7fb5981091f0 2024-09-19T09:17:04.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.465+0000 7fb595ffb640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fb5840c56a0 0x7fb5840c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.466+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7fb5900cfa10 con 0x7fb5981091f0 2024-09-19T09:17:04.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.473+0000 7fb597fff640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fb5840c56a0 0x7fb5840c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.474+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb59001f020 con 0x7fb5981091f0 2024-09-19T09:17:04.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.486+0000 7fb597fff640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fb5840c56a0 0x7fb5840c7b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5800096c0 tx=0x7fb580005fd0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:04.869+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 --> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb578000bc0 con 0x7fb5840c56a0 2024-09-19T09:17:04.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:04 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:04.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:04 smithi122 ceph-mon[34247]: from='client.24925 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:04.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:04 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:04.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:04 smithi083 ceph-mon[30926]: from='client.24925 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:05.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.033+0000 7fb595ffb640 1 -- 172.21.15.83:0/3481923050 <== mgr.15288 v2:172.21.15.83:6800/2671255807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb578000bc0 con 0x7fb5840c56a0 2024-09-19T09:17:05.034 INFO:teuthology.orchestra.run.smithi083.stdout:/ 1m 6m3h 2024-09-19T09:17:05.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fb5840c56a0 msgr2=0x7fb5840c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fb5840c56a0 0x7fb5840c7b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5800096c0 tx=0x7fb580005fd0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 msgr2=0x7fb5981a7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 0x7fb5981a7080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b450 tx=0x7fb59000b910 comp rx=0 tx=0).stop 2024-09-19T09:17:05.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 shutdown_connections 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb59811b140 0x7fb5981ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fb5840c56a0 0x7fb5840c7b60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5981095d0 0x7fb5981a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 --2- 172.21.15.83:0/3481923050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5981091f0 0x7fb5981a7080 secure :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b450 tx=0x7fb59000b910 comp rx=0 tx=0).stop 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.036+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 >> 172.21.15.83:0/3481923050 conn(0x7fb59806ce00 msgr2=0x7fb59811b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.037+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 shutdown_connections 2024-09-19T09:17:05.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.037+0000 7fb59ed6d640 1 -- 172.21.15.83:0/3481923050 wait complete. 2024-09-19T09:17:05.055 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:17:05.065 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:05.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:04 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:05.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:04 smithi184 ceph-mon[35007]: from='client.24925 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:05.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.259+0000 7f51e4142640 1 -- 172.21.15.83:0/4097099389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc074590 msgr2=0x7f51dc074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.259+0000 7f51e4142640 1 --2- 172.21.15.83:0/4097099389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc074590 0x7f51dc074970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009900 tx=0x7f51d402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.269+0000 7f51e4142640 1 -- 172.21.15.83:0/4097099389 shutdown_connections 2024-09-19T09:17:05.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.269+0000 7f51e4142640 1 --2- 172.21.15.83:0/4097099389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51dc112ac0 0x7f51dc114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.269+0000 7f51e4142640 1 --2- 172.21.15.83:0/4097099389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074eb0 0x7f51dc112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.269+0000 7f51e4142640 1 --2- 172.21.15.83:0/4097099389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc074590 0x7f51dc074970 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.269+0000 7f51e4142640 1 -- 172.21.15.83:0/4097099389 >> 172.21.15.83:0/4097099389 conn(0x7f51dc0fd7d0 msgr2=0x7f51dc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.275+0000 7f51e4142640 1 -- 172.21.15.83:0/4097099389 shutdown_connections 2024-09-19T09:17:05.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.276+0000 7f51e4142640 1 -- 172.21.15.83:0/4097099389 wait complete. 2024-09-19T09:17:05.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.277+0000 7f51e4142640 1 Processor -- start 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 -- start start 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074590 0x7f51dc0722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51dc074eb0 0x7f51dc0727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc112ac0 0x7f51dc072d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc06c510 con 0x7f51dc074590 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc06c390 con 0x7f51dc074eb0 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.280+0000 7f51e4142640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc06c690 con 0x7f51dc112ac0 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.281+0000 7f51e26df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc112ac0 0x7f51dc072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.281+0000 7f51e1ede640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074590 0x7f51dc0722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.281+0000 7f51e1ede640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074590 0x7f51dc0722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46798/0 (socket says 172.21.15.83:46798) 2024-09-19T09:17:05.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.281+0000 7f51e1ede640 1 -- 172.21.15.83:0/1339176841 learned_addr learned my addr 172.21.15.83:0/1339176841 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:05.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.283+0000 7f51e26df640 1 -- 172.21.15.83:0/1339176841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51dc074eb0 msgr2=0x7f51dc0727f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:17:05.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.283+0000 7f51e26df640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51dc074eb0 0x7f51dc0727f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.283+0000 7f51e26df640 1 -- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074590 msgr2=0x7f51dc0722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.283+0000 7f51e26df640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074590 0x7f51dc0722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.283+0000 7f51e26df640 1 -- 172.21.15.83:0/1339176841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51dc10ffb0 con 0x7f51dc112ac0 2024-09-19T09:17:05.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.284+0000 7f51e26df640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc112ac0 0x7f51dc072d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51c400be20 tx=0x7f51c400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.287+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4019070 con 0x7f51dc112ac0 2024-09-19T09:17:05.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.287+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51c40148f0 con 0x7f51dc112ac0 2024-09-19T09:17:05.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.287+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4012870 con 0x7f51dc112ac0 2024-09-19T09:17:05.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.289+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51dc110240 con 0x7f51dc112ac0 2024-09-19T09:17:05.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.289+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51dc110710 con 0x7f51dc112ac0 2024-09-19T09:17:05.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.293+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51dc075cd0 con 0x7f51dc112ac0 2024-09-19T09:17:05.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.296+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f51c4014aa0 con 0x7f51dc112ac0 2024-09-19T09:17:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.296+0000 7f51daffd640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f51c80a3500 0x7f51c80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.297+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7f51c40cf880 con 0x7f51dc112ac0 2024-09-19T09:17:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.297+0000 7f51e1ede640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f51c80a3500 0x7f51c80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.298+0000 7f51e1ede640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f51c80a3500 0x7f51c80a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51d4031440 tx=0x7f51d40095a0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.305+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51c409b8d0 con 0x7f51dc112ac0 2024-09-19T09:17:05.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.665+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51dc104f00 con 0x7f51dc112ac0 2024-09-19T09:17:05.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.668+0000 7f51daffd640 1 -- 172.21.15.83:0/1339176841 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+25466 (secure 0 0 0) 0x7f51c409fbd0 con 0x7f51dc112ac0 2024-09-19T09:17:05.670 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:17:05.670 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":107,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:17:02.616430+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/2542755280":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/931956178":"2024-09-20T09:03:00.037901+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/2542755280":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/3669863104":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/512658189":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3109717577":"2024-09-20T09:03:00.037901+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:05.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f51c80a3500 msgr2=0x7f51c80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f51c80a3500 0x7f51c80a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51d4031440 tx=0x7f51d40095a0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc112ac0 msgr2=0x7f51dc072d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc112ac0 0x7f51dc072d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51c400be20 tx=0x7f51c400bf10 comp rx=0 tx=0).stop 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 shutdown_connections 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f51c80a3500 0x7f51c80a59c0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51d4031440 tx=0x7f51d40095a0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc112ac0 0x7f51dc072d30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51dc074eb0 0x7f51dc0727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 --2- 172.21.15.83:0/1339176841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51dc074590 0x7f51dc0722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.673+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 >> 172.21.15.83:0/1339176841 conn(0x7f51dc0fd7d0 msgr2=0x7f51dc0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.674+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 shutdown_connections 2024-09-19T09:17:05.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.674+0000 7f51e4142640 1 -- 172.21.15.83:0/1339176841 wait complete. 2024-09-19T09:17:05.694 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:55:57.133143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:00:33.986862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:00:35.909807+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T09:00:42.339991+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T09:17:05.695 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:17:05.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.896+0000 7fd2b9896640 1 -- 172.21.15.83:0/3461869417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 msgr2=0x7fd2b4114e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.896+0000 7fd2b9896640 1 --2- 172.21.15.83:0/3461869417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 0x7fd2b4114e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009900 tx=0x7fd29c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.902+0000 7fd2b9896640 1 -- 172.21.15.83:0/3461869417 shutdown_connections 2024-09-19T09:17:05.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.902+0000 7fd2b9896640 1 --2- 172.21.15.83:0/3461869417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 0x7fd2b4114e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.902+0000 7fd2b9896640 1 --2- 172.21.15.83:0/3461869417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2b4074eb0 0x7fd2b4112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.902+0000 7fd2b9896640 1 --2- 172.21.15.83:0/3461869417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.902+0000 7fd2b9896640 1 -- 172.21.15.83:0/3461869417 >> 172.21.15.83:0/3461869417 conn(0x7fd2b40fd7c0 msgr2=0x7fd2b40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.907+0000 7fd2b9896640 1 -- 172.21.15.83:0/3461869417 shutdown_connections 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.907+0000 7fd2b9896640 1 -- 172.21.15.83:0/3461869417 wait complete. 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 Processor -- start 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 -- start start 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b41120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2b4074eb0 0x7fd2b410b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 0x7fd2b410b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4118400 con 0x7fd2b4074590 2024-09-19T09:17:05.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4118280 con 0x7fd2b4112a90 2024-09-19T09:17:05.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.908+0000 7fd2b9896640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4118580 con 0x7fd2b4074eb0 2024-09-19T09:17:05.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.911+0000 7fd2b2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b41120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.911+0000 7fd2b2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b41120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46814/0 (socket says 172.21.15.83:46814) 2024-09-19T09:17:05.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.911+0000 7fd2b2ffd640 1 -- 172.21.15.83:0/4118354587 learned_addr learned my addr 172.21.15.83:0/4118354587 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:05.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.914+0000 7fd2b37fe640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 0x7fd2b410b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.915+0000 7fd2b27fc640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2b4074eb0 0x7fd2b410b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.915+0000 7fd2b2ffd640 1 -- 172.21.15.83:0/4118354587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2b4074eb0 msgr2=0x7fd2b410b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.915+0000 7fd2b2ffd640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2b4074eb0 0x7fd2b410b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.915+0000 7fd2b2ffd640 1 -- 172.21.15.83:0/4118354587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 msgr2=0x7fd2b410b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.915+0000 7fd2b2ffd640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 0x7fd2b410b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.915+0000 7fd2b2ffd640 1 -- 172.21.15.83:0/4118354587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b410bce0 con 0x7fd2b4074590 2024-09-19T09:17:05.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.917+0000 7fd2b2ffd640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b41120e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400ba50 tx=0x7fd2a400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.917+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4019070 con 0x7fd2b4074590 2024-09-19T09:17:05.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.917+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b410fc00 con 0x7fd2b4074590 2024-09-19T09:17:05.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.917+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b41101a0 con 0x7fd2b4074590 2024-09-19T09:17:05.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.917+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2a400cbe0 con 0x7fd2b4074590 2024-09-19T09:17:05.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.917+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007640 con 0x7fd2b4074590 2024-09-19T09:17:05.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.921+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b410bf70 con 0x7fd2b4074590 2024-09-19T09:17:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.928+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd2a401c070 con 0x7fd2b4074590 2024-09-19T09:17:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.929+0000 7fd2b8894640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd2a00a34c0 0x7fd2a00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.929+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7fd2a40cf650 con 0x7fd2b4074590 2024-09-19T09:17:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.930+0000 7fd2b27fc640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd2a00a34c0 0x7fd2a00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.932+0000 7fd2b27fc640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd2a00a34c0 0x7fd2a00a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2b410c920 tx=0x7fd2ac00a4c0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:05.935+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2a409bcf0 con 0x7fd2b4074590 2024-09-19T09:17:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:05 smithi122 ceph-mon[34247]: pgmap v442: 129 pgs: 7 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 236 KiB/s rd, 308 KiB/s wr, 140 op/s 2024-09-19T09:17:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:05 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:05.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:05 smithi122 ceph-mon[34247]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:05.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:05 smithi083 ceph-mon[30926]: pgmap v442: 129 pgs: 7 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 236 KiB/s rd, 308 KiB/s wr, 140 op/s 2024-09-19T09:17:05.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:05 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:05.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:05 smithi083 ceph-mon[30926]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:05 smithi184 ceph-mon[35007]: pgmap v442: 129 pgs: 7 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 236 KiB/s rd, 308 KiB/s wr, 140 op/s 2024-09-19T09:17:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:05 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:06.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:05 smithi184 ceph-mon[35007]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:06.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.283+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd2b4104ef0 con 0x7fd2b4074590 2024-09-19T09:17:06.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.284+0000 7fd2b8894640 1 -- 172.21.15.83:0/4118354587 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7fd2a409b5f0 con 0x7fd2b4074590 2024-09-19T09:17:06.287 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-09-19T09:17:06.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd2a00a34c0 msgr2=0x7fd2a00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd2a00a34c0 0x7fd2a00a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2b410c920 tx=0x7fd2ac00a4c0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 msgr2=0x7fd2b41120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b41120e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400ba50 tx=0x7fd2a400bf10 comp rx=0 tx=0).stop 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 shutdown_connections 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b4112a90 0x7fd2b410b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd2a00a34c0 0x7fd2a00a5980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2b4074eb0 0x7fd2b410b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 --2- 172.21.15.83:0/4118354587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b4074590 0x7fd2b41120e0 secure :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400ba50 tx=0x7fd2a400bf10 comp rx=0 tx=0).stop 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.291+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 >> 172.21.15.83:0/4118354587 conn(0x7fd2b40fd7c0 msgr2=0x7fd2b40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.292+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 shutdown_connections 2024-09-19T09:17:06.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.292+0000 7fd2b9896640 1 -- 172.21.15.83:0/4118354587 wait complete. 2024-09-19T09:17:06.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:17:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.504+0000 7fad14f91640 1 -- 172.21.15.83:0/2107684177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109460 msgr2=0x7fad10110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.504+0000 7fad14f91640 1 --2- 172.21.15.83:0/2107684177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109460 0x7fad10110250 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fad00009900 tx=0x7fad0002a440 comp rx=0 tx=0).stop 2024-09-19T09:17:06.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.510+0000 7fad14f91640 1 -- 172.21.15.83:0/2107684177 shutdown_connections 2024-09-19T09:17:06.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.510+0000 7fad14f91640 1 --2- 172.21.15.83:0/2107684177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad1011b140 0x7fad1011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.510+0000 7fad14f91640 1 --2- 172.21.15.83:0/2107684177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad10109840 0x7fad10109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.510+0000 7fad14f91640 1 --2- 172.21.15.83:0/2107684177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109460 0x7fad10110250 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.510+0000 7fad14f91640 1 -- 172.21.15.83:0/2107684177 >> 172.21.15.83:0/2107684177 conn(0x7fad1006cdd0 msgr2=0x7fad1006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:06.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.515+0000 7fad14f91640 1 -- 172.21.15.83:0/2107684177 shutdown_connections 2024-09-19T09:17:06.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.520+0000 7fad14f91640 1 -- 172.21.15.83:0/2107684177 wait complete. 2024-09-19T09:17:06.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 Processor -- start 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 -- start start 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 0x7fad10118730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109840 0x7fad101117b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad1011b140 0x7fad10111cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fad10120cb0 con 0x7fad10109840 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad10120b30 con 0x7fad1011b140 2024-09-19T09:17:06.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.521+0000 7fad14f91640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad10120e30 con 0x7fad10109460 2024-09-19T09:17:06.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.522+0000 7fad0e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 0x7fad10118730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.522+0000 7fad0e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 0x7fad10118730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.83:49156/0 (socket says 172.21.15.83:49156) 2024-09-19T09:17:06.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.522+0000 7fad0e59c640 1 -- 172.21.15.83:0/148141875 learned_addr learned my addr 172.21.15.83:0/148141875 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:06.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.522+0000 7fad07fff640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109840 0x7fad101117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.523+0000 7fad0e59c640 1 -- 172.21.15.83:0/148141875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad1011b140 msgr2=0x7fad10111cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:17:06.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.523+0000 7fad0e59c640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad1011b140 0x7fad10111cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.523+0000 7fad0e59c640 1 -- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109840 msgr2=0x7fad101117b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.523+0000 7fad0e59c640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109840 0x7fad101117b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.523+0000 7fad0e59c640 1 -- 172.21.15.83:0/148141875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad101122e0 con 0x7fad10109460 2024-09-19T09:17:06.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.527+0000 7fad0e59c640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 0x7fad10118730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad00009230 tx=0x7fad00003e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:06.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.534+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0003f030 con 0x7fad10109460 2024-09-19T09:17:06.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.534+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad00032bf0 con 0x7fad10109460 2024-09-19T09:17:06.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.534+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00035070 con 0x7fad10109460 2024-09-19T09:17:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.537+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad10112570 con 0x7fad10109460 2024-09-19T09:17:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.537+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad10116490 con 0x7fad10109460 2024-09-19T09:17:06.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.538+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1006dbe0 con 0x7fad10109460 2024-09-19T09:17:06.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.547+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fad00042030 con 0x7fad10109460 2024-09-19T09:17:06.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.547+0000 7fad077fe640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7facfc0a35c0 0x7facfc0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.548+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7fad000f0fe0 con 0x7fad10109460 2024-09-19T09:17:06.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.552+0000 7fad07fff640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7facfc0a35c0 0x7facfc0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.552+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad00032da0 con 0x7fad10109460 2024-09-19T09:17:06.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.560+0000 7fad07fff640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7facfc0a35c0 0x7facfc0a5a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad10112f70 tx=0x7facf800a2d0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:06.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.890+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad10116f70 con 0x7fad10109460 2024-09-19T09:17:06.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.890+0000 7fad077fe640 1 -- 172.21.15.83:0/148141875 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) ==== 104+0+11 (secure 0 0 0) 0x7fad000bd5f0 con 0x7fad10109460 2024-09-19T09:17:06.891 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-09-19T09:17:06.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7facfc0a35c0 msgr2=0x7facfc0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7facfc0a35c0 0x7facfc0a5a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad10112f70 tx=0x7facf800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 msgr2=0x7fad10118730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 0x7fad10118730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad00009230 tx=0x7fad00003e30 comp rx=0 tx=0).stop 2024-09-19T09:17:06.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 shutdown_connections 2024-09-19T09:17:06.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad1011b140 0x7fad10111cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad10109840 0x7fad101117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7facfc0a35c0 0x7facfc0a5a80 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad10112f70 tx=0x7facf800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 --2- 172.21.15.83:0/148141875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad10109460 0x7fad10118730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.896+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 >> 172.21.15.83:0/148141875 conn(0x7fad1006cdd0 msgr2=0x7fad1011b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:06.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.897+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 shutdown_connections 2024-09-19T09:17:06.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:06.897+0000 7fad14f91640 1 -- 172.21.15.83:0/148141875 wait complete. 2024-09-19T09:17:06.915 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:17:06.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:06 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1339176841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:17:06.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:06 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/4118354587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:17:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:06 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1339176841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:17:06.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:06 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/4118354587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:17:07.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.096+0000 7f22718d0640 1 -- 172.21.15.83:0/3520420465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c101350 msgr2=0x7f226c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.096+0000 7f22718d0640 1 --2- 172.21.15.83:0/3520420465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c101350 0x7f226c10d880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2264009cd0 tx=0x7f226402a910 comp rx=0 tx=0).stop 2024-09-19T09:17:07.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.098+0000 7f22718d0640 1 -- 172.21.15.83:0/3520420465 shutdown_connections 2024-09-19T09:17:07.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.098+0000 7f22718d0640 1 --2- 172.21.15.83:0/3520420465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c101350 0x7f226c10d880 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.098+0000 7f22718d0640 1 --2- 172.21.15.83:0/3520420465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f226c1009b0 0x7f226c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.098+0000 7f22718d0640 1 --2- 172.21.15.83:0/3520420465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.098+0000 7f22718d0640 1 -- 172.21.15.83:0/3520420465 >> 172.21.15.83:0/3520420465 conn(0x7f226c0fc690 msgr2=0x7f226c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.104+0000 7f22718d0640 1 -- 172.21.15.83:0/3520420465 shutdown_connections 2024-09-19T09:17:07.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.105+0000 7f22718d0640 1 -- 172.21.15.83:0/3520420465 wait complete. 2024-09-19T09:17:07.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.105+0000 7f22718d0640 1 Processor -- start 2024-09-19T09:17:07.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.105+0000 7f22718d0640 1 -- start start 2024-09-19T09:17:07.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f22718d0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c1009b0 0x7f226c196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f22718d0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f226c101350 0x7f226c1966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f22718d0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f22718d0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f226c10fbb0 con 0x7f226c1009b0 2024-09-19T09:17:07.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f22718d0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f226c10fa30 con 0x7f226c101350 2024-09-19T09:17:07.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f22718d0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f226c10fd30 con 0x7f226c1069c0 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f226b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f226b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.83:49162/0 (socket says 172.21.15.83:49162) 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.106+0000 7f226b7fe640 1 -- 172.21.15.83:0/1398118874 learned_addr learned my addr 172.21.15.83:0/1398118874 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.107+0000 7f226b7fe640 1 -- 172.21.15.83:0/1398118874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f226c101350 msgr2=0x7f226c1966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.107+0000 7f226b7fe640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f226c101350 0x7f226c1966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.107+0000 7f226b7fe640 1 -- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c1009b0 msgr2=0x7f226c196190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.107+0000 7f226b7fe640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c1009b0 0x7f226c196190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.107+0000 7f226b7fe640 1 -- 172.21.15.83:0/1398118874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c19b180 con 0x7f226c1069c0 2024-09-19T09:17:07.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.107+0000 7f226b7fe640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c19aa50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2264009bf0 tx=0x7f22640308d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.113+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264030a10 con 0x7f226c1069c0 2024-09-19T09:17:07.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.114+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c19b410 con 0x7f226c1069c0 2024-09-19T09:17:07.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.114+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c1a2d00 con 0x7f226c1069c0 2024-09-19T09:17:07.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.114+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2264003970 con 0x7f226c1069c0 2024-09-19T09:17:07.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.114+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264004750 con 0x7f226c1069c0 2024-09-19T09:17:07.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.115+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c005290 con 0x7f226c1069c0 2024-09-19T09:17:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.118+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2264004b40 con 0x7f226c1069c0 2024-09-19T09:17:07.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.119+0000 7f22708ce640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f22580a35c0 0x7f22580a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.120+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7f22640fa300 con 0x7f226c1069c0 2024-09-19T09:17:07.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.125+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22640553e0 con 0x7f226c1069c0 2024-09-19T09:17:07.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.129+0000 7f226affd640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f22580a35c0 0x7f22580a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.140+0000 7f226affd640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f22580a35c0 0x7f22580a5a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2254009670 tx=0x7f2254006bd0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:06 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1339176841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:17:07.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:06 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/4118354587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:17:07.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.474+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f224c005850 con 0x7f226c1069c0 2024-09-19T09:17:07.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.476+0000 7f22708ce640 1 -- 172.21.15.83:0/1398118874 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) ==== 100+0+11 (secure 0 0 0) 0x7f22640c6a20 con 0x7f226c1069c0 2024-09-19T09:17:07.477 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-09-19T09:17:07.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.480+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f22580a35c0 msgr2=0x7f22580a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.480+0000 7f22718d0640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f22580a35c0 0x7f22580a5a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2254009670 tx=0x7f2254006bd0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.480+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 msgr2=0x7f226c19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.480+0000 7f22718d0640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c19aa50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2264009bf0 tx=0x7f22640308d0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.481+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 shutdown_connections 2024-09-19T09:17:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.481+0000 7f22718d0640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f22580a35c0 0x7f22580a5a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.481+0000 7f22718d0640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f226c1069c0 0x7f226c19aa50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.481+0000 7f22718d0640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f226c101350 0x7f226c1966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.481+0000 7f22718d0640 1 --2- 172.21.15.83:0/1398118874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f226c1009b0 0x7f226c196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.481+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 >> 172.21.15.83:0/1398118874 conn(0x7f226c0fc690 msgr2=0x7f226c0fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:07.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.483+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 shutdown_connections 2024-09-19T09:17:07.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.483+0000 7f22718d0640 1 -- 172.21.15.83:0/1398118874 wait complete. 2024-09-19T09:17:07.501 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T09:17:07.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.744+0000 7fc19b59e640 1 -- 172.21.15.83:0/539200880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 msgr2=0x7fc1940b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.744+0000 7fc19b59e640 1 --2- 172.21.15.83:0/539200880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b9900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc19c067ef0 tx=0x7fc19c08e330 comp rx=0 tx=0).stop 2024-09-19T09:17:07.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.752+0000 7fc19b59e640 1 -- 172.21.15.83:0/539200880 shutdown_connections 2024-09-19T09:17:07.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.752+0000 7fc19b59e640 1 --2- 172.21.15.83:0/539200880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b9900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.752+0000 7fc19b59e640 1 --2- 172.21.15.83:0/539200880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 0x7fc1940b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.752+0000 7fc19b59e640 1 --2- 172.21.15.83:0/539200880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1940a47f0 0x7fc1940a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.752+0000 7fc19b59e640 1 -- 172.21.15.83:0/539200880 >> 172.21.15.83:0/539200880 conn(0x7fc19401a0d0 msgr2=0x7fc19401a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:07.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.757+0000 7fc19b59e640 1 -- 172.21.15.83:0/539200880 shutdown_connections 2024-09-19T09:17:07.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.759+0000 7fc19b59e640 1 -- 172.21.15.83:0/539200880 wait complete. 2024-09-19T09:17:07.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.760+0000 7fc19b59e640 1 Processor -- start 2024-09-19T09:17:07.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.760+0000 7fc19b59e640 1 -- start start 2024-09-19T09:17:07.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.761+0000 7fc19b59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1940a47f0 0x7fc1940b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.761+0000 7fc19b59e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 0x7fc1940b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.761+0000 7fc19b59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.761+0000 7fc19b59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc1940aef60 con 0x7fc1940a47f0 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.761+0000 7fc19b59e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc1940aede0 con 0x7fc1940a5110 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.761+0000 7fc19b59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc1940af0e0 con 0x7fc1940b7510 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.762+0000 7fc19ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.762+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 0x7fc1940b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.762+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 0x7fc1940b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.83:38048/0 (socket says 172.21.15.83:38048) 2024-09-19T09:17:07.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.762+0000 7fc199d9b640 1 -- 172.21.15.83:0/320049808 learned_addr learned my addr 172.21.15.83:0/320049808 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:07.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.764+0000 7fc19ad9d640 1 -- 172.21.15.83:0/320049808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 msgr2=0x7fc1940b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.764+0000 7fc19ad9d640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 0x7fc1940b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.764+0000 7fc19ad9d640 1 -- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1940a47f0 msgr2=0x7fc1940b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.764+0000 7fc19ad9d640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1940a47f0 0x7fc1940b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.764+0000 7fc19ad9d640 1 -- 172.21.15.83:0/320049808 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1940b3740 con 0x7fc1940b7510 2024-09-19T09:17:07.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.768+0000 7fc19ad9d640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b3150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc19c067ef0 tx=0x7fc19c06a600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.770+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c096b40 con 0x7fc1940b7510 2024-09-19T09:17:07.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.770+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1940b39d0 con 0x7fc1940b7510 2024-09-19T09:17:07.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.770+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc194147670 con 0x7fc1940b7510 2024-09-19T09:17:07.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.771+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc19c096ce0 con 0x7fc1940b7510 2024-09-19T09:17:07.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.771+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0978a0 con 0x7fc1940b7510 2024-09-19T09:17:07.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.774+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c005290 con 0x7fc1940b7510 2024-09-19T09:17:07.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.780+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc19c097a40 con 0x7fc1940b7510 2024-09-19T09:17:07.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.780+0000 7fc18b7fe640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1840a35c0 0x7fc1840a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.781+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7fc19c153a60 con 0x7fc1940b7510 2024-09-19T09:17:07.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.782+0000 7fc19a59c640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1840a35c0 0x7fc1840a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.788+0000 7fc19a59c640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1840a35c0 0x7fc1840a5a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0096f0 tx=0x7fc18c006c40 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:07.790+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc19c120200 con 0x7fc1940b7510 2024-09-19T09:17:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:07 smithi122 ceph-mon[34247]: pgmap v443: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 237 KiB/s rd, 309 KiB/s wr, 147 op/s 2024-09-19T09:17:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:07 smithi122 ceph-mon[34247]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/148141875' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:17:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1398118874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:17:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:07 smithi083 ceph-mon[30926]: pgmap v443: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 237 KiB/s rd, 309 KiB/s wr, 147 op/s 2024-09-19T09:17:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:07 smithi083 ceph-mon[30926]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:07 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/148141875' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:17:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:07 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1398118874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:17:08.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.123+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc17c005850 con 0x7fc1940b7510 2024-09-19T09:17:08.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.124+0000 7fc18b7fe640 1 -- 172.21.15.83:0/320049808 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v107) ==== 103+0+11 (secure 0 0 0) 0x7fc19c096e90 con 0x7fc1940b7510 2024-09-19T09:17:08.125 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1840a35c0 msgr2=0x7fc1840a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1840a35c0 0x7fc1840a5a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0096f0 tx=0x7fc18c006c40 comp rx=0 tx=0).stop 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 msgr2=0x7fc1940b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b3150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc19c067ef0 tx=0x7fc19c06a600 comp rx=0 tx=0).stop 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 shutdown_connections 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc1840a35c0 0x7fc1840a5a80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1940b7510 0x7fc1940b3150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1940a5110 0x7fc1940b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 --2- 172.21.15.83:0/320049808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1940a47f0 0x7fc1940b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 >> 172.21.15.83:0/320049808 conn(0x7fc19401a0d0 msgr2=0x7fc1940b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 shutdown_connections 2024-09-19T09:17:08.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.127+0000 7fc19b59e640 1 -- 172.21.15.83:0/320049808 wait complete. 2024-09-19T09:17:08.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:17:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:07 smithi184 ceph-mon[35007]: pgmap v443: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 237 KiB/s rd, 309 KiB/s wr, 147 op/s 2024-09-19T09:17:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:07 smithi184 ceph-mon[35007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:17:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/148141875' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:17:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1398118874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:17:08.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.336+0000 7fd9a31bd640 1 -- 172.21.15.83:0/3946374070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 msgr2=0x7fd99c109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.336+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/3946374070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c109630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd988009900 tx=0x7fd98802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:08.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.344+0000 7fd9a31bd640 1 -- 172.21.15.83:0/3946374070 shutdown_connections 2024-09-19T09:17:08.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.344+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/3946374070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd99c109b70 0x7fd99c1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.344+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/3946374070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c109630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.344+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/3946374070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 0x7fd99c10ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.344+0000 7fd9a31bd640 1 -- 172.21.15.83:0/3946374070 >> 172.21.15.83:0/3946374070 conn(0x7fd99c06d240 msgr2=0x7fd99c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:08.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.349+0000 7fd9a31bd640 1 -- 172.21.15.83:0/3946374070 shutdown_connections 2024-09-19T09:17:08.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.353+0000 7fd9a31bd640 1 -- 172.21.15.83:0/3946374070 wait complete. 2024-09-19T09:17:08.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.354+0000 7fd9a31bd640 1 Processor -- start 2024-09-19T09:17:08.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 -- start start 2024-09-19T09:17:08.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c11e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd99c109b70 0x7fd99c11eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 0x7fd99c119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c118430 con 0x7fd99c10e620 2024-09-19T09:17:08.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1182b0 con 0x7fd99c1091f0 2024-09-19T09:17:08.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.356+0000 7fd9a31bd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1185b0 con 0x7fd99c109b70 2024-09-19T09:17:08.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.357+0000 7fd9a0f59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c11e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.357+0000 7fd9a0f59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c11e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.83:38056/0 (socket says 172.21.15.83:38056) 2024-09-19T09:17:08.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.357+0000 7fd9a0f59640 1 -- 172.21.15.83:0/2950151075 learned_addr learned my addr 172.21.15.83:0/2950151075 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:08.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.357+0000 7fd9a175a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 0x7fd99c119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a0f59640 1 -- 172.21.15.83:0/2950151075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd99c109b70 msgr2=0x7fd99c11eeb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a0f59640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd99c109b70 0x7fd99c11eeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a0f59640 1 -- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 msgr2=0x7fd99c119a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a0f59640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 0x7fd99c119a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a0f59640 1 -- 172.21.15.83:0/2950151075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c11a250 con 0x7fd99c1091f0 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a175a640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 0x7fd99c119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:08.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.358+0000 7fd9a0f59640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c11e970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd99000b450 tx=0x7fd99000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.364+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990015020 con 0x7fd99c1091f0 2024-09-19T09:17:08.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.364+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd990011d40 con 0x7fd99c1091f0 2024-09-19T09:17:08.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.364+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99000f340 con 0x7fd99c1091f0 2024-09-19T09:17:08.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.365+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c11a540 con 0x7fd99c1091f0 2024-09-19T09:17:08.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.365+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c1bc4e0 con 0x7fd99c1091f0 2024-09-19T09:17:08.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.366+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99c073e20 con 0x7fd99c1091f0 2024-09-19T09:17:08.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.371+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd990018020 con 0x7fd99c1091f0 2024-09-19T09:17:08.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.373+0000 7fd999ffb640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd98c0a35c0 0x7fd98c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.373+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9526+0+0 (secure 0 0 0) 0x7fd9900d0110 con 0x7fd99c1091f0 2024-09-19T09:17:08.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.375+0000 7fd99bfff640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd98c0a35c0 0x7fd98c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.376+0000 7fd99bfff640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd98c0a35c0 0x7fd98c0a5a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd988005c20 tx=0x7fd988000bc0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.382+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd99001f020 con 0x7fd99c1091f0 2024-09-19T09:17:08.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.813+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fd99c110a40 con 0x7fd99c1091f0 2024-09-19T09:17:08.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.829+0000 7fd999ffb640 1 -- 172.21.15.83:0/2950151075 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+742872 (secure 0 0 0) 0x7fd99000d040 con 0x7fd99c1091f0 2024-09-19T09:17:08.830 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:17:08.839 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:17:08.839 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 26, 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "active_gid": 15288, 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "active_name": "x", 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "active_addrs": { 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:6800", 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2671255807 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.840 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:6801", 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2671255807 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "active_addr": "172.21.15.83:6801/2671255807", 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "active_change": "2024-09-19T09:03:00.038113+0000", 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "available": true, 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "standbys": [ 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 24814, 2024-09-19T09:17:08.841 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "y", 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.842 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.843 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.844 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.845 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:08.846 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.847 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.848 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:08.848 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:08.848 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.848 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.849 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.850 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.851 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.852 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.853 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.854 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-09-19T09:17:08.855 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-09-19T09:17:08.856 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.857 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.858 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.859 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:08.860 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-09-19T09:17:08.861 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.862 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.863 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.864 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.865 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.866 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.867 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.868 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.869 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:08.870 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-09-19T09:17:08.871 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-19T09:17:08.872 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "read", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap", 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap-read" 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.873 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.874 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.875 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.876 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:08.877 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-09-19T09:17:08.878 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.879 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.880 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:17:08.881 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.882 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.883 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-09-19T09:17:08.884 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm_log_destination": { 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm_log_destination", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.885 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "file", 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "file,syslog", 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "syslog" 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-09-19T09:17:08.886 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-09-19T09:17:08.887 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.888 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-09-19T09:17:08.889 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.890 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-09-19T09:17:08.891 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-09-19T09:17:08.892 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-09-19T09:17:08.893 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.894 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.895 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.896 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.897 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.898 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.899 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.900 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-09-19T09:17:08.901 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:08.902 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:17:08.903 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba": { 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.904 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:17:08.905 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.907 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.908 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.909 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.910 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-09-19T09:17:08.911 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-09-19T09:17:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "grafana_dashboards_path": { 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:17:08.913 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-09-19T09:17:08.914 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-09-19T09:17:08.915 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-09-19T09:17:08.916 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:08.917 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.918 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.919 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.920 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:08.921 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.922 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.923 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.924 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.925 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.926 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.927 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.928 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:17:08.929 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:17:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:17:08.931 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.932 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.933 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.934 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.935 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.936 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.937 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.938 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.939 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.940 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.941 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.942 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.943 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:08.944 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.945 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.946 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.947 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.948 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.949 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.950 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.951 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.952 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.953 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.954 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.955 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:17:08.956 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:17:08.957 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.958 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.959 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.960 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.962 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.963 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.964 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.965 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.966 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.967 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.969 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.970 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.973 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.974 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.975 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.976 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.977 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.978 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.979 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.980 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.981 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.982 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.983 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.984 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.985 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.986 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-09-19T09:17:08.988 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.989 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.990 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.991 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.992 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.993 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.994 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.995 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.996 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.997 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:08.998 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:08.999 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-19T09:17:09.000 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.001 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.002 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.003 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.004 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.005 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.006 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-09-19T09:17:09.007 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.008 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.009 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.010 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.011 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.012 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.013 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-19T09:17:09.014 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.016 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.017 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.018 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.019 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.019 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.019 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.020 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.020 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.020 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.020 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.021 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.022 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.023 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.024 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.025 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.026 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.027 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.028 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.029 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.030 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-09-19T09:17:09.031 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.032 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.033 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.034 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.035 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.036 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.037 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.038 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.039 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.040 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-09-19T09:17:09.041 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-09-19T09:17:09.042 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.044 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.045 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.046 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.047 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.048 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-09-19T09:17:09.049 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-09-19T09:17:09.050 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-19T09:17:09.051 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-09-19T09:17:09.052 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-09-19T09:17:09.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-09-19T09:17:09.054 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.055 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.056 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.057 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.058 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.059 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.060 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.061 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.062 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.063 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.064 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.065 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.066 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.067 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-09-19T09:17:09.068 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.069 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.070 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.071 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.072 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.073 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.074 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:17:09.075 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.076 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.077 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.078 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.079 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.080 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:17:09.081 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.082 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.083 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.084 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-09-19T09:17:09.085 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.086 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.087 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.088 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.089 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.090 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.091 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.092 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.093 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.095 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.101 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.106 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.107 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.109 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.110 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.111 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.112 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.113 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.114 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.115 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.116 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.117 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.118 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.119 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.120 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.121 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.122 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.123 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.124 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.125 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.126 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.127 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.128 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.129 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:17:09.130 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-19T09:17:09.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.132 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.133 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.134 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.135 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.136 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-09-19T09:17:09.137 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.138 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.139 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.140 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.141 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.142 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.143 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.144 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.145 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.146 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-09-19T09:17:09.147 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:17:09.148 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-09-19T09:17:09.149 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.150 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.151 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-09-19T09:17:09.152 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.153 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.154 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.155 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.156 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.157 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.158 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.159 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.160 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-09-19T09:17:09.161 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.162 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.163 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.164 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.165 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.166 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.167 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.169 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.170 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.171 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.172 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.173 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.174 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.175 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.176 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.178 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.179 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.180 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-09-19T09:17:09.181 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.182 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.183 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.184 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.185 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.186 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.187 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.188 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.189 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.190 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.191 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.192 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.193 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.194 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.195 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.196 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.197 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.198 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.200 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.201 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.202 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.203 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.204 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.205 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.206 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.207 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.208 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.209 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.210 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.211 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.212 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.213 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.214 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.215 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.216 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.217 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.218 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.219 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.220 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.221 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.222 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.223 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.224 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-09-19T09:17:09.225 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.226 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.227 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.228 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.229 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.230 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.231 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.232 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.233 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.234 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.235 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.236 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.237 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.238 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.239 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.240 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-19T09:17:09.241 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-09-19T09:17:09.243 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-09-19T09:17:09.244 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-09-19T09:17:09.245 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.246 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.247 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.248 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.249 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.250 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-09-19T09:17:09.251 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.252 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.253 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.254 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.255 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.256 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.258 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.259 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.260 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.261 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.262 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.263 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.264 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.265 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:17:09.266 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "periodic_async_work": { 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "periodic_async_work", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Periodically check for async work", 2024-09-19T09:17:09.267 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:17:09.268 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.269 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-09-19T09:17:09.270 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-09-19T09:17:09.271 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.272 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.273 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.274 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-09-19T09:17:09.278 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.279 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-09-19T09:17:09.280 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.281 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 24817, 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "z", 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.282 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.283 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.285 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.286 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.288 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.289 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.291 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.295 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.296 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.297 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.298 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.299 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.300 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.301 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.302 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.303 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.304 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.305 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.306 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.307 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.308 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.309 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-09-19T09:17:09.310 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-19T09:17:09.311 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "read", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap", 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap-read" 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.312 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:17:09.313 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:17:09.314 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:17:09.315 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:17:09.316 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-09-19T09:17:09.317 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-09-19T09:17:09.318 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-09-19T09:17:09.319 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-09-19T09:17:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.321 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.322 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.323 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm_log_destination": { 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm_log_destination", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "file", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "file,syslog", 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "syslog" 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.324 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.325 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.326 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.327 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.328 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.329 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.330 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.331 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:17:09.332 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:17:09.333 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.334 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.335 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.336 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.337 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.338 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.339 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:17:09.340 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:17:09.341 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba": { 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:17:09.342 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:17:09.343 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.344 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.345 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.346 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.347 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.348 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.349 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.350 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "grafana_dashboards_path": { 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.351 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.352 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.353 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.354 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.355 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.356 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.357 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.358 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.359 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.360 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.361 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.362 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.363 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.364 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.365 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.366 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-09-19T09:17:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:17:09.368 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.369 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.370 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.371 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.372 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.373 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.374 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.375 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.376 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.377 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.378 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.379 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.380 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.381 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.382 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.383 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.384 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.385 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.386 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.387 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.388 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.389 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.391 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.392 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.393 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.394 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.395 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.396 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.397 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.398 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.399 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.400 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.407 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.408 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.414 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.419 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.420 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.421 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.422 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.423 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.424 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.425 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.426 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.426 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.426 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.426 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.426 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.426 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.428 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.429 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.430 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.431 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.432 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.433 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.434 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.435 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.436 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.437 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.438 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.439 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.440 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.441 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.442 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.443 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.444 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.446 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.447 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.448 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.449 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.450 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-19T09:17:09.451 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.453 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.454 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.455 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.456 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.457 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.458 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.459 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.460 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.461 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.462 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.463 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.464 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.465 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.466 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.467 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-09-19T09:17:09.468 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.469 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.470 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.471 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.472 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.473 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.474 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.475 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.477 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.478 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.479 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-09-19T09:17:09.480 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.481 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.482 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.483 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.484 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.485 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.486 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-09-19T09:17:09.487 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-09-19T09:17:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-19T09:17:09.489 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-09-19T09:17:09.490 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-09-19T09:17:09.491 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-09-19T09:17:09.492 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.494 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.495 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.496 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.497 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.498 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.499 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.500 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.501 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.502 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.503 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.504 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.505 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.506 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.507 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.508 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.509 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.510 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.511 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.512 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.513 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.514 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.515 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.516 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.517 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.518 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-09-19T09:17:09.519 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:17:09.520 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.521 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:17:09.522 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.523 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.524 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.525 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.526 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.527 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.528 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.529 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.530 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.531 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.532 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.533 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.534 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.535 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.536 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.537 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.538 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.539 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.540 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.541 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.542 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.543 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.544 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.545 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.546 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-09-19T09:17:09.547 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.548 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.549 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.550 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.552 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.553 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.554 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.556 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.557 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.559 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.560 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.561 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.564 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.565 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.566 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.567 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.569 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.570 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.571 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.572 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.573 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.574 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.575 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.576 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.577 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:17:09.578 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.579 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.580 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.581 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.582 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.583 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.584 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.585 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.586 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.587 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.588 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.589 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.590 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.591 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.592 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.593 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.594 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.595 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.596 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.597 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.598 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.599 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.600 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.601 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.602 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.603 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.604 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.605 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.606 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.607 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.608 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.609 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.610 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.611 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.612 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.613 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.614 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.615 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.616 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.617 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.618 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.619 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.620 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.621 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.623 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.624 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.625 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.626 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.627 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.628 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.629 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.630 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.631 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.632 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.633 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.634 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.635 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.636 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.637 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.638 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.639 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.640 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-19T09:17:09.641 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.642 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.643 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.644 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.645 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.646 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.647 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.648 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.649 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.650 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.651 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.652 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.653 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.655 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.656 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.657 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.658 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.659 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.660 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.661 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.663 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.664 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.666 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.667 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.668 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.669 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.670 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.671 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.672 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.673 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.674 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.675 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.676 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.677 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.678 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.679 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-09-19T09:17:09.680 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.681 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.682 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.683 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.684 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.685 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-09-19T09:17:09.686 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-09-19T09:17:09.687 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-09-19T09:17:09.688 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.689 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.690 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.691 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.692 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.693 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.694 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.695 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.696 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.697 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.698 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.699 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.701 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "periodic_async_work": { 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "periodic_async_work", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Periodically check for async work", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.702 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.703 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:17:09.704 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.705 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-09-19T09:17:09.706 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.708 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.709 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.710 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.711 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.712 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.713 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.714 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-09-19T09:17:09.715 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.716 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "modules": [ 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "dashboard", 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "iostat", 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "nfs", 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "restful", 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "snap_schedule" 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.717 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.718 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.719 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.720 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.721 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.722 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.723 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.724 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.725 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.726 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.727 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.728 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.729 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.730 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.731 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.732 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.733 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.734 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.735 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.736 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.737 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.738 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.739 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.740 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.741 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.742 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.743 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.744 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.745 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.746 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "read", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap", 2024-09-19T09:17:09.747 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap-read" 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.748 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.749 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.750 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.751 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-09-19T09:17:09.752 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.753 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.754 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.755 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.756 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.757 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.758 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm_log_destination": { 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm_log_destination", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "file", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "file,syslog", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "syslog" 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:17:09.759 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.760 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:17:09.761 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.761 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.761 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.764 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.765 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.766 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.767 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.768 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-09-19T09:17:09.769 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.770 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.771 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.772 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.773 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.774 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.776 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.777 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.778 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.779 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.780 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba": { 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.781 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.782 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.783 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.784 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.785 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.786 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.787 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.788 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.789 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "grafana_dashboards_path": { 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.790 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.791 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.792 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.793 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.794 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-09-19T09:17:09.795 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.796 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.797 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.798 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.799 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.800 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-09-19T09:17:09.801 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.802 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.803 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.804 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-09-19T09:17:09.805 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.806 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.807 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.808 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.810 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.811 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.812 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.813 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-09-19T09:17:09.814 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-09-19T09:17:09.815 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-09-19T09:17:09.816 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:17:09.817 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:17:09.818 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:17:09.819 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.820 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.821 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.822 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.823 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.824 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.825 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.826 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.827 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:17:09.828 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.829 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.830 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.831 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.832 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.833 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.834 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.835 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.836 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.837 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.838 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.839 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.840 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.841 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.842 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.843 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.844 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.845 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.846 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.847 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.849 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.850 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.851 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.852 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.853 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.855 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.856 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.857 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.858 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.859 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.860 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.861 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.862 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.863 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.864 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.865 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.866 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.867 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.868 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.870 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.871 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.872 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.873 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:17:09.874 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.875 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.876 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.877 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.878 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.879 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.880 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.881 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.882 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.883 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.884 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.885 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.886 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.887 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-19T09:17:09.889 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.890 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.891 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.892 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.893 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.894 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.895 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.896 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.897 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:17:09.898 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:17:09.899 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.900 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:17:09.901 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:17:09.902 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:17:09.903 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.905 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.906 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.907 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.908 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.913 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.915 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.916 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.917 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.918 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.919 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.920 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.921 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.922 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.923 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.924 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.925 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.926 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.927 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.928 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.929 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.930 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.931 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.932 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.933 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.934 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.935 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.936 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.937 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.938 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.940 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.941 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.942 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.943 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.944 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.945 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.946 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.947 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-09-19T09:17:09.948 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.949 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.950 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.951 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.952 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.953 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-09-19T09:17:09.954 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-09-19T09:17:09.955 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-09-19T09:17:09.956 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-09-19T09:17:09.957 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.958 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.959 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.960 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.961 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.962 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.963 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.964 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.965 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.966 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.967 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.970 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.971 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.974 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.975 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.976 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.977 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.978 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.979 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.980 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.981 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.983 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.984 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.985 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.986 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.987 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.988 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.989 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.990 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.991 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.992 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.993 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.994 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.995 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.996 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.997 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:09.998 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:09.999 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:10.000 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-09-19T09:17:10.001 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.002 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.003 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.004 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.005 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.006 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.007 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.008 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.009 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:17:10.010 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:17:10.011 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.012 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.013 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.014 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.015 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.016 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.018 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.019 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.020 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:10.021 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.022 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.023 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.024 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.025 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.026 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.027 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.028 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.030 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.031 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.032 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.033 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.034 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-09-19T09:17:10.035 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.036 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.037 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.038 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.039 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.040 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.041 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.042 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.043 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.044 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.045 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-19T09:17:10.048 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-19T09:17:10.048 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.048 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.048 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.048 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-09-19T09:17:10.049 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.050 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.051 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.052 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.053 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:17:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.056 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.057 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.058 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.059 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.060 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.061 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.062 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.063 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.064 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.065 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.066 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.067 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.068 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.069 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.070 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.071 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.072 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.073 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.075 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-19T09:17:10.076 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.077 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.078 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.079 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.080 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.081 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.083 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.084 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.085 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.089 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.094 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.095 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.100 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.101 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.102 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.103 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.104 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.105 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.106 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.107 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:17:10.108 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.109 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.110 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.111 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.112 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.113 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.114 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.115 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-09-19T09:17:10.116 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.117 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.118 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.119 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.120 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.121 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.122 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.123 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.124 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.125 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.132 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.133 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.134 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.135 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.136 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.137 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.138 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.139 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "periodic_async_work": { 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "periodic_async_work", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.140 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Periodically check for async work", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.141 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-19T09:17:10.143 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.144 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.145 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.146 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.148 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.149 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-19T09:17:10.150 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-09-19T09:17:10.151 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-09-19T09:17:10.152 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.153 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.154 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "services": { 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "dashboard": "https://172.21.15.83:8443/" 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "always_on_modules": { 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "octopus": [ 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-19T09:17:10.155 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "pacific": [ 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-19T09:17:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "quincy": [ 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.157 INFO:teuthology.orchestra.run.smithi083.stdout: "reef": [ 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "squid": [ 2024-09-19T09:17:10.158 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "last_failure_osd_epoch": 90, 2024-09-19T09:17:10.159 INFO:teuthology.orchestra.run.smithi083.stdout: "active_clients": [ 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1405919188 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "libcephsqlite", 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:10.160 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1076923602 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-19T09:17:10.161 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3362975722 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 674237622 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.162 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3633528154 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-19T09:17:10.163 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2702473151 2024-09-19T09:17:10.164 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.164 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.164 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:10.164 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-19T09:17:10.164 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:17:10.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:08 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/320049808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T09:17:10.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:09 smithi184 ceph-mon[35007]: pgmap v444: 129 pgs: 21 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 51 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 372 KiB/s rd, 418 KiB/s wr, 244 op/s 2024-09-19T09:17:10.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:09 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2950151075' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:17:10.166 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:08 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/320049808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T09:17:10.166 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:09 smithi122 ceph-mon[34247]: pgmap v444: 129 pgs: 21 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 51 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 372 KiB/s rd, 418 KiB/s wr, 244 op/s 2024-09-19T09:17:10.166 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:09 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2950151075' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:17:10.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.837+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd98c0a35c0 msgr2=0x7fd98c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.837+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd98c0a35c0 0x7fd98c0a5a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd988005c20 tx=0x7fd988000bc0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.837+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 msgr2=0x7fd99c11e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.837+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c11e970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd99000b450 tx=0x7fd99000b910 comp rx=0 tx=0).stop 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.838+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 shutdown_connections 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.838+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd99c10e620 0x7fd99c119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.838+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fd98c0a35c0 0x7fd98c0a5a80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.838+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd99c109b70 0x7fd99c11eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.838+0000 7fd9a31bd640 1 --2- 172.21.15.83:0/2950151075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd99c1091f0 0x7fd99c11e970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.838+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 >> 172.21.15.83:0/2950151075 conn(0x7fd99c06d240 msgr2=0x7fd99c072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.840+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 shutdown_connections 2024-09-19T09:17:10.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:08.840+0000 7fd9a31bd640 1 -- 172.21.15.83:0/2950151075 wait complete. 2024-09-19T09:17:10.174 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:17:10.174 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:17:10.175 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:08 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/320049808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T09:17:10.175 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:09 smithi083 ceph-mon[30926]: pgmap v444: 129 pgs: 21 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 51 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 372 KiB/s rd, 418 KiB/s wr, 244 op/s 2024-09-19T09:17:10.175 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:09 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2950151075' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:17:10.662 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:11 smithi122 ceph-mon[34247]: pgmap v445: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 372 KiB/s rd, 418 KiB/s wr, 255 op/s 2024-09-19T09:17:11.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:11 smithi083 ceph-mon[30926]: pgmap v445: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 372 KiB/s rd, 418 KiB/s wr, 255 op/s 2024-09-19T09:17:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:11 smithi184 ceph-mon[35007]: pgmap v445: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 372 KiB/s rd, 418 KiB/s wr, 255 op/s 2024-09-19T09:17:13.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:13 smithi122 ceph-mon[34247]: pgmap v446: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 217 KiB/s rd, 236 KiB/s wr, 253 op/s 2024-09-19T09:17:13.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:13 smithi083 ceph-mon[30926]: pgmap v446: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 217 KiB/s rd, 236 KiB/s wr, 253 op/s 2024-09-19T09:17:14.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:13 smithi184 ceph-mon[35007]: pgmap v446: 129 pgs: 16 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 68 active+clean; 16 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 217 KiB/s rd, 236 KiB/s wr, 253 op/s 2024-09-19T09:17:15.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:15 smithi122 ceph-mon[34247]: pgmap v447: 129 pgs: 9 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 100 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 185 KiB/s rd, 201 KiB/s wr, 247 op/s 2024-09-19T09:17:15.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:15 smithi083 ceph-mon[30926]: pgmap v447: 129 pgs: 9 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 100 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 185 KiB/s rd, 201 KiB/s wr, 247 op/s 2024-09-19T09:17:16.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:15 smithi184 ceph-mon[35007]: pgmap v447: 129 pgs: 9 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 100 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 185 KiB/s rd, 201 KiB/s wr, 247 op/s 2024-09-19T09:17:17.251 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:17:17.251 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:17.251 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1004, 2024-09-19T09:17:17.251 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 870, 2024-09-19T09:17:17.251 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 587524, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 1360590, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 15, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 5, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.093873277, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.026620673, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.051268542, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.018743607, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 868, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.116591926, 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000134322 2024-09-19T09:17:17.252 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 931, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000165749, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000178 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2102, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 1644, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 2926727, 2024-09-19T09:17:17.253 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 1222881, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 15, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 8, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.165336127, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.057742675, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.117750714, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.018372813, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1641, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.145623223, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000088740 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.254 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 2095, 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000367953, 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000175 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1873648, 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 574496 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:17.255 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 3735, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 3168, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1416245, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 1442220, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 12, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 4, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.364861129, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.147605582, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.204732462, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.026149248, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3168, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.249784654, 2024-09-19T09:17:17.256 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000078846 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 5690, 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.001189921, 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000209 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 126064 2024-09-19T09:17:17.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 1, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-MDSRank": { 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 520, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.140310890, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000269828 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 951, 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.041011995, 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000043125 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": { 2024-09-19T09:17:17.259 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 357, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "reply": 286, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "reply_latency": { 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 286, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 163.370888840, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.571226884 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_reply": 0, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "forward": 71, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_commit": 11, 2024-09-19T09:17:17.260 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_split": 0, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_merge": 0, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes": 11, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_top": 0, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_bottom": 0, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pin_tail": 11, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pinned": 11, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_expired": 318, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 0, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "subtrees": 2, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse": 729, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_hit": 527, 2024-09-19T09:17:17.261 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_forward": 71, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_discover": 88, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_lock": 0, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "load_cent": 209, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "q": 0, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "exported": 3, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "exported_inodes": 162, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "imported": 3, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "imported_inodes": 35, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:17.262 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rfiles": 4, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rbytes": 234, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rsnaps": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_inode_file_caps": 15, 2024-09-19T09:17:17.263 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_revoke": 169, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_grant": 156, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps": 435, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps_dirty": 187, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_cap_release": 10, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "process_request_cap_release": 50 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_cache": { 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update": 10, 2024-09-19T09:17:17.264 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update_receipt": 306, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_try_discover": 194, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_send_discover": 234, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_handle_discover": 12, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_created": 25, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_enqueued": 25, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_migrated": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:17.265 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_started": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_completed": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_exportdir": 3, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_flush": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_inodestats": 0 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_log": { 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "evlrg": 0, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "evadd": 525, 2024-09-19T09:17:17.266 INFO:teuthology.orchestra.run.smithi083.stdout: "evex": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "evtrm": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "ev": 525, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "evexg": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "evexd": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "segadd": 2, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "segex": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "segtrm": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "seg": 2, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "segmjr": 2, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "segexg": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "segexd": 0, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "expos": 4194304, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "wrpos": 4957415, 2024-09-19T09:17:17.267 INFO:teuthology.orchestra.run.smithi083.stdout: "rdpos": 0, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "jlat": { 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 179, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 2.917755809, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.016300311 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "replayed": 0 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_mem": { 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 18, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "ino+": 275, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "ino-": 257, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "dir": 23, 2024-09-19T09:17:17.268 INFO:teuthology.orchestra.run.smithi083.stdout: "dir+": 164, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "dir-": 141, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "dn": 37, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "dn+": 380, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "dn-": 343, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "cap": 0, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "cap+": 46, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "cap-": 46, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "rss": 56664, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "heap": 223520 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_server": { 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_client_request": 413, 2024-09-19T09:17:17.269 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_server_request": 7, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_request": 357, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_session": 16, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_peer_request": 40, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "req_create_latency": { 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getattr_latency": { 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.001923344, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001923344 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.270 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "req_link_latency": { 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookup_latency": { 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 123, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 125.951544506, 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 1.023996296 2024-09-19T09:17:17.271 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupino_latency": { 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupname_latency": { 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.272 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lssnap_latency": { 2024-09-19T09:17:17.273 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mkdir_latency": { 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mknod_latency": { 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.274 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mksnap_latency": { 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "req_open_latency": { 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 133, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 37.346172885, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.280798292 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "req_readdir_latency": { 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 4, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.003669529, 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000917382 2024-09-19T09:17:17.275 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rename_latency": { 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.276 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmdir_latency": { 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setattr_latency": { 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setlayout_latency": { 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setxattr_latency": { 2024-09-19T09:17:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "req_symlink_latency": { 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "req_unlink_latency": { 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 25, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.067578576, 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.002703143 2024-09-19T09:17:17.280 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_sessions": { 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "session_count": 1, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "session_add": 2, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "session_remove": 1, 2024-09-19T09:17:17.281 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_open": 1, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_stale": 0, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "total_load": 88, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "average_load": 88, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "avg_session_uptime": 856, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:17.282 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:17.283 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:17.284 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 315339, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 126, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-19T09:17:17.285 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 9656, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 196, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 114992, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 659, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:17.286 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "objecter": { 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_active": 0, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_laggy": 0, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send": 1279, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send_bytes": 793032, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_resend": 31, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_reply": 1279, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "op_latency": { 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1279, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 119.776124367, 2024-09-19T09:17:17.287 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.093648259 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "op_inflight": 0, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "oplen_avg": { 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1279, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1414 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "op": 1279, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "op_r": 1, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "op_w": 1278, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "op_rmw": 0, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "op_pg": 0, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_stat": 0, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_create": 10, 2024-09-19T09:17:17.288 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_read": 1, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_write": 180, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writefull": 32, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writesame": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_append": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_zero": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_truncate": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_delete": 948, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_mapext": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_getxattr": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_setxattr": 20, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:17.289 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_call": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_watch": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_notify": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_other": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_active": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_send": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_resend": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_ping": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_active": 0, 2024-09-19T09:17:17.290 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_send": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_resend": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_active": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_send": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_resend": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_active": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_send": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_resend": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "command_active": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "command_send": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "command_resend": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "map_epoch": 107, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "map_full": 0, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "map_inc": 20, 2024-09-19T09:17:17.291 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_sessions": 12, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_open": 17, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_close": 5, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_laggy": 0, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_wr": 169, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_rd": 0, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_del": 54 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "oft": { 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_objs": 1, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_updates": 0, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_removes": 0 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.292 INFO:teuthology.orchestra.run.smithi083.stdout: "osd-slow-ops": { 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_ops_count": 6 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "purge_queue": { 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops_high_water": 52, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing": 0, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_high_water": 1, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed_ops": 936, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed": 25, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:17.293 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 6837, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 4293384, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 6837, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 6837, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 4293384, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.294 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 1279, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 796957, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 1279, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 796957, 2024-09-19T09:17:17.295 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 1024, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:17.296 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 1279, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 1279, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 1279, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1279, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:17.297 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 25, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 3925, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 25, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 1, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 3925, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:17.298 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle-0x5572fb2d4960": { 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 525, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 763111, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 525, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 179, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 763111, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:17.299 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:17.300 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:17.300 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.300 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:17.300 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:17:17.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:17 smithi122 ceph-mon[34247]: pgmap v448: 129 pgs: 9 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 100 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 123 KiB/s rd, 98 KiB/s wr, 191 op/s 2024-09-19T09:17:17.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:17 smithi083 ceph-mon[30926]: pgmap v448: 129 pgs: 9 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 100 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 123 KiB/s rd, 98 KiB/s wr, 191 op/s 2024-09-19T09:17:18.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:17 smithi184 ceph-mon[35007]: pgmap v448: 129 pgs: 9 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 100 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 123 KiB/s rd, 98 KiB/s wr, 191 op/s 2024-09-19T09:17:19.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:19 smithi122 ceph-mon[34247]: pgmap v449: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 126 KiB/s rd, 101 KiB/s wr, 225 op/s 2024-09-19T09:17:19.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:19 smithi083 ceph-mon[30926]: pgmap v449: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 126 KiB/s rd, 101 KiB/s wr, 225 op/s 2024-09-19T09:17:20.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:19 smithi184 ceph-mon[35007]: pgmap v449: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 126 KiB/s rd, 101 KiB/s wr, 225 op/s 2024-09-19T09:17:21.755 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:21 smithi083 ceph-mon[30926]: pgmap v450: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 145 op/s 2024-09-19T09:17:21.755 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:21 smithi083 ceph-mon[30926]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T09:17:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:21 smithi184 ceph-mon[35007]: pgmap v450: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 145 op/s 2024-09-19T09:17:21.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:21 smithi184 ceph-mon[35007]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T09:17:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:21 smithi122 ceph-mon[34247]: pgmap v450: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 145 op/s 2024-09-19T09:17:21.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:21 smithi122 ceph-mon[34247]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T09:17:23.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:23 smithi184 ceph-mon[35007]: pgmap v452: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.5 KiB/s wr, 106 op/s 2024-09-19T09:17:23.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:23 smithi122 ceph-mon[34247]: pgmap v452: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.5 KiB/s wr, 106 op/s 2024-09-19T09:17:23.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:23 smithi083 ceph-mon[30926]: pgmap v452: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.5 KiB/s wr, 106 op/s 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds.exported=3 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds.imported=3 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=10 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=306 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:24.298 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-19T09:17:24.298 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:17:24.299 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:17:24.556 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 289, 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 278, 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1605600, 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 171104, 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-19T09:17:25.059 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.047442357, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.018253337, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.041920399, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 277, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.016713199, 2024-09-19T09:17:25.060 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000060336 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1605600, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 171104 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2, 2024-09-19T09:17:25.061 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 212, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 320, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 194448, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.014712160, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.010699380, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001702895, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:17:25.062 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 209, 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.015961978, 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000076373 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:25.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 194448 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 4, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 4, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 448, 2024-09-19T09:17:25.064 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.002278743, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000039160, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.002233501, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.004086916, 2024-09-19T09:17:25.065 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001362305 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.066 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:25.067 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:25.068 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148977, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 30, 2024-09-19T09:17:25.069 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:25.070 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 928, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 291, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 1564781, 2024-09-19T09:17:25.071 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 291, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 291, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1564781, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:25.072 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:17:25.647 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:25 smithi083 ceph-mon[30926]: pgmap v453: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.9 KiB/s wr, 62 op/s 2024-09-19T09:17:25.647 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:25 smithi083 ceph-mon[30926]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T09:17:25.676 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T09:17:25.676 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:17:25.677 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:17:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:25 smithi184 ceph-mon[35007]: pgmap v453: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.9 KiB/s wr, 62 op/s 2024-09-19T09:17:25.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:25 smithi184 ceph-mon[35007]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T09:17:25.922 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:25 smithi122 ceph-mon[34247]: pgmap v453: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.9 KiB/s wr, 62 op/s 2024-09-19T09:17:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:25 smithi122 ceph-mon[34247]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T09:17:26.446 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:17:26.446 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:26.446 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 876, 2024-09-19T09:17:26.446 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 873, 2024-09-19T09:17:26.446 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 297851, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 276791, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 7, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 2, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.098188973, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.035848542, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.025047206, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.029739737, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 872, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.067335098, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000077219 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.447 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1766, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 1974, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1211327, 2024-09-19T09:17:26.448 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 1087169, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 7, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 5, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.129418228, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.040833904, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.033673917, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.045708794, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1971, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.099321927, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000050391 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:26.449 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 526160 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 348, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 305, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1856212, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 174853, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:26.450 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.047718722, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.016949311, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.045704904, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000067598, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 304, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.018542093, 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000060993 2024-09-19T09:17:26.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1854864, 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 173888 2024-09-19T09:17:26.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 1, 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-MDSRank": { 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 4423, 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.101234445, 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000022888 2024-09-19T09:17:26.453 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.454 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": { 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "reply": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "reply_latency": { 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_reply": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "forward": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_commit": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_split": 0, 2024-09-19T09:17:26.455 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_merge": 0, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes": 26, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_top": 0, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_bottom": 26, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pin_tail": 0, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pinned": 26, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_expired": 0, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 0, 2024-09-19T09:17:26.456 INFO:teuthology.orchestra.run.smithi083.stdout: "subtrees": 1, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_hit": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_forward": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_discover": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_lock": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "load_cent": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "q": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "exported": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "exported_inodes": 0, 2024-09-19T09:17:26.457 INFO:teuthology.orchestra.run.smithi083.stdout: "imported": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "imported_inodes": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rfiles": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rbytes": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rsnaps": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:26.458 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:26.459 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_cap_release": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "process_request_cap_release": 0 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_cache": { 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update_receipt": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_try_discover": 0, 2024-09-19T09:17:26.460 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_send_discover": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_handle_discover": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_created": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_enqueued": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_migrated": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_started": 0, 2024-09-19T09:17:26.461 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_completed": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_exportdir": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_flush": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_inodestats": 0 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_log": { 2024-09-19T09:17:26.462 INFO:teuthology.orchestra.run.smithi083.stdout: "evlrg": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "evadd": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "evex": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "evtrm": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "ev": 525, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "evexg": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "evexd": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "segadd": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "segex": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "segtrm": 0, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "seg": 2, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "segmjr": 2, 2024-09-19T09:17:26.463 INFO:teuthology.orchestra.run.smithi083.stdout: "segexg": 0, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "segexd": 0, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "expos": 4194304, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "wrpos": 4957415, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "rdpos": 4950304, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "jlat": { 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.464 INFO:teuthology.orchestra.run.smithi083.stdout: "replayed": 525 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_mem": { 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 4, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "ino+": 176, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "ino-": 172, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir": 2, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir+": 15, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir-": 13, 2024-09-19T09:17:26.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dn": 26, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "dn+": 198, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "dn-": 172, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "cap": 0, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "cap+": 0, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "cap-": 0, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "rss": 50836, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "heap": 215328 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_server": { 2024-09-19T09:17:26.466 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_client_request": 0, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_server_request": 0, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_request": 0, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_session": 0, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_peer_request": 0, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "req_create_latency": { 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.467 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getattr_latency": { 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.468 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.469 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.469 INFO:teuthology.orchestra.run.smithi083.stdout: "req_link_latency": { 2024-09-19T09:17:26.469 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.469 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.469 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookup_latency": { 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.470 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupino_latency": { 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupname_latency": { 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.471 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:26.472 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lssnap_latency": { 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.473 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mkdir_latency": { 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mknod_latency": { 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mksnap_latency": { 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "req_open_latency": { 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "req_readdir_latency": { 2024-09-19T09:17:26.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rename_latency": { 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmdir_latency": { 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:26.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setattr_latency": { 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setlayout_latency": { 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.479 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setxattr_latency": { 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "req_symlink_latency": { 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.480 INFO:teuthology.orchestra.run.smithi083.stdout: "req_unlink_latency": { 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_sessions": { 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "session_count": 1, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "session_add": 2, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "session_remove": 1, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_open": 1, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_stale": 0, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "total_load": 0, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "average_load": 0, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avg_session_uptime": 1894, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-19T09:17:26.482 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:26.483 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:26.484 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 197513, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 56, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:26.485 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 9416, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 190, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 32032, 2024-09-19T09:17:26.486 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 136, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "objecter": { 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_active": 0, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_laggy": 0, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send": 2636, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send_bytes": 21, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_resend": 3, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_reply": 2636, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "op_latency": { 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 2636, 2024-09-19T09:17:26.487 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 102.401547885, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.038847324 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "op_inflight": 0, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "oplen_avg": { 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 2636, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 2637 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "op": 2636, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "op_r": 2636, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "op_w": 0, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "op_rmw": 0, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "op_pg": 0, 2024-09-19T09:17:26.488 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_stat": 1649, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_create": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_read": 985, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_write": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writefull": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writesame": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_append": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_zero": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_truncate": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_delete": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_mapext": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:26.489 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_getxattr": 1, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_setxattr": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_call": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_watch": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_notify": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_other": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_active": 0, 2024-09-19T09:17:26.490 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_send": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_resend": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_ping": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_active": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_send": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_resend": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_active": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_send": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_resend": 0, 2024-09-19T09:17:26.491 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_active": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_send": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_resend": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "command_active": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "command_send": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "command_resend": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "map_epoch": 109, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "map_full": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "map_inc": 22, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_sessions": 6, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_open": 8, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_close": 2, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_laggy": 0, 2024-09-19T09:17:26.492 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_wr": 0, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_rd": 2, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_del": 0 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "oft": { 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_objs": 0, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_updates": 0, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_removes": 0 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osd-slow-ops": { 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_ops_count": 0 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.493 INFO:teuthology.orchestra.run.smithi083.stdout: "purge_queue": { 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing": 0, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_high_water": 0, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed_ops": 0, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed": 0, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:26.494 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 2986, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 3076118, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 2986, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 2986, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 3076118, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.495 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:26.496 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 2636, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 763116, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 2636, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 763116, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 1024, 2024-09-19T09:17:26.498 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:26.498 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-19T09:17:26.498 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-19T09:17:26.498 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 2636, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 2636, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 2636, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 2636, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:26.499 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 0, 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:26.500 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle-0x55b1d01eab40": { 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:26.501 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 0, 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:26.502 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:26.503 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:26.503 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:26.503 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.503 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:26.503 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:17:27.254 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T09:17:27.254 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T09:17:27.255 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-19T09:17:27.255 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-19T09:17:27.255 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-19T09:17:27.255 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:27.255 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:27.255 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-19T09:17:27.255 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:17:27.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:17:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:27.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:27 smithi083 ceph-mon[30926]: pgmap v455: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:17:27.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:27 smithi184 ceph-mon[35007]: pgmap v455: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:17:27.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:27 smithi122 ceph-mon[34247]: pgmap v455: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T09:17:28.618 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 291, 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 280, 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1606144, 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 172384, 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-19T09:17:28.638 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.047922016, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.019333316, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.041865178, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 279, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.014899164, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000053402 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:28.639 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1606144, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 172384 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 214, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 320, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 194800, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.014384524, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.010175901, 2024-09-19T09:17:28.640 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001914155, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 211, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.014939742, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000070804 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:17:28.641 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 194800 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 4, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 4, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 448, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.002436374, 2024-09-19T09:17:28.642 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000043996, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.002388742, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.004326845, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001442281 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:28.643 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:28.644 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:28.645 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:28.646 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148977, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 30, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:28.647 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 928, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-19T09:17:28.648 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 293, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 1565041, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 293, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 293, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1565041, 2024-09-19T09:17:28.649 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-19T09:17:28.650 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-19T09:17:28.650 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-19T09:17:28.650 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-19T09:17:28.652 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:28.652 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-19T09:17:28.652 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-19T09:17:29.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:29 smithi184 ceph-mon[35007]: pgmap v456: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-19T09:17:29.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:29 smithi122 ceph-mon[34247]: pgmap v456: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-19T09:17:29.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:29 smithi083 ceph-mon[30926]: pgmap v456: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-19T09:17:31.764 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:31 smithi122 ceph-mon[34247]: pgmap v457: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.6 KiB/s rd, 520 B/s wr, 10 op/s 2024-09-19T09:17:31.822 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:31 smithi083 ceph-mon[30926]: pgmap v457: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.6 KiB/s rd, 520 B/s wr, 10 op/s 2024-09-19T09:17:31.856 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T09:17:31.856 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T09:17:31.857 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T09:17:31.857 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T09:17:31.857 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T09:17:31.857 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T09:17:31.857 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T09:17:31.857 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T09:17:31.857 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:17:31.857 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:17:31.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:31 smithi184 ceph-mon[35007]: pgmap v457: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.6 KiB/s rd, 520 B/s wr, 10 op/s 2024-09-19T09:17:32.223 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:17:33.371 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-19T09:17:33.371 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 5370, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 6779, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2008459, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 11442413, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 11, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.405907772, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.168622943, 2024-09-19T09:17:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.222221399, 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.043961071, 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 6777, 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.561562478, 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000082862 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8637, 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001576785, 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000182 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 404704 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 11621, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 13167, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 4251509, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 11717343, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 14, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.850425330, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.274397645, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.482036424, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.155805664, 2024-09-19T09:17:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 13166, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.466188212, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000111361 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 20821, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.003534926, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000169 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 433856, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 270320 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 3966, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 4096, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 3316107, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 2018641, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 17, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.338359631, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.118940574, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.211874463, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.042354713, 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4094, 2024-09-19T09:17:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.743425081, 2024-09-19T09:17:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000181588 2024-09-19T09:17:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5343, 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001032994, 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000193 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 2043680, 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 216880 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-19T09:17:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1792, 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.891045459, 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001055270 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2208, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.146928950, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000066543 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 3703, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 3486, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3486, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 110.408677563, 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.031672024 2024-09-19T09:17:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 217, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 12, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 610, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 8, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 602, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 609, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 471, 2024-09-19T09:17:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 3, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 3, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 3, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 5641, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 5063, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 207, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 13, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 47, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 36, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 7, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 440, 2024-09-19T09:17:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 9, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 282, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 6, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 1209, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 1588, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 6, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 3210, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 1031, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 20, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 2217 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-19T09:17:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 344, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 12, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 8, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 21, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 768, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 22, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 672, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 589, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 61, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 7, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 4488, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 4488, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 6, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 6, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-19T09:17:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 16383362, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 866, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 14.848486214, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.017146057 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 182, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 1112, 2024-09-19T09:17:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 930, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 42, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 167, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 125, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 610, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 1717, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 1107, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 3, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 819, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 816, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 62964, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 231712 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-19T09:17:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 4705, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 120, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 3703, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 45, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 328, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 636, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.646935363, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001017193 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1094, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.310022302, 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000283384 2024-09-19T09:17:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 61, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.136201699, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002232814 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 380, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 36.273165969, 2024-09-19T09:17:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.095455699 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 14, 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002252586, 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000160899 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 105, 2024-09-19T09:17:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.108458561, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001032938 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 14, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 18.822297401, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 1.344449814 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 226, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 46.655558739, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.206440525 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 166, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.572923984, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.003451349 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 106, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 5.361718553, 2024-09-19T09:17:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.050582250 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 38, 2024-09-19T09:17:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.524353614, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.013798779 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.050321639, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.006290204 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005209202, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001041840 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001637435, 2024-09-19T09:17:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000409358 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.019896176, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002487022 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 13, 2024-09-19T09:17:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.009702166, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000746320 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 608, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.908022174, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001493457 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 6, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 4, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 484, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 242, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 843, 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-19T09:17:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 511499, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 177, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 88, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 1, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-19T09:17:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 187, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 990318, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 8379, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 3919, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 12319118, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 37, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 3919, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3919, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 159.780260157, 2024-09-19T09:17:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.040770671 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3919, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 4127 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 3919, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 38, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 3881, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-09-19T09:17:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 11, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 38, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 904, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 76, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 2719, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 22, 2024-09-19T09:17:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 6, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-19T09:17:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 109, 2024-09-19T09:17:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 28, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 265, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 86 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 5 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 52, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 7, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 2205, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 589, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 20953, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 7607125, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 20953, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 20953, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 7607125, 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 3919, 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 12389175, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3919, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 12389175, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 3919, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 3919, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3919, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 3919, 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 589, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 70057, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 589, 2024-09-19T09:17:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 38, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 70057, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55bb3e8ec960": { 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 4488, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 12189058, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 4488, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 866, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 12189058, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-19T09:17:33.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:33 smithi122 ceph-mon[34247]: pgmap v458: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:33.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:33 smithi184 ceph-mon[35007]: pgmap v458: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:33.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:33 smithi083 ceph-mon[30926]: pgmap v458: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:34.524 INFO:tasks.check_counter:Daemon mds.b mds.exported=7 2024-09-19T09:17:34.524 INFO:tasks.check_counter:Daemon mds.b mds.imported=9 2024-09-19T09:17:34.524 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=344 2024-09-19T09:17:34.524 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=12 2024-09-19T09:17:34.524 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T09:17:34.524 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=14 2024-09-19T09:17:34.525 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=8 2024-09-19T09:17:34.525 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-09-19T09:17:34.525 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:17:34.525 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:17:34.782 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 3342, 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 3344, 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 9390993, 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1062763, 2024-09-19T09:17:35.374 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 6, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 2, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.246713928, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.069589341, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.073400543, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.086220916, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3342, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.097504961, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000029175 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.375 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 385, 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 337, 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1884024, 2024-09-19T09:17:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 186502, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.055103525, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.018868877, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.051401129, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000954041, 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:35.377 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 337, 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.037003288, 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000109802 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1877072, 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 177536 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 3, 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 215, 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 588, 2024-09-19T09:17:35.379 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 528798, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 7, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.011291751, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.007235356, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.002056550, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000026280, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 212, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.014383295, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000067845 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:35.380 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 528480 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-19T09:17:35.381 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5793, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.119413686, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000020613 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:35.383 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-09-19T09:17:35.384 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 770, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 71, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 699, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 668, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-09-19T09:17:35.385 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 1, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-09-19T09:17:35.386 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:35.387 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-09-19T09:17:35.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-19T09:17:35.389 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.390 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 1822, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 5, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-19T09:17:35.391 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 12658904, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 12655490, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 1822 2024-09-19T09:17:35.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 619, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 962, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 343, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 25, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 113, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 88, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 770, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 1165, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 395, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-09-19T09:17:35.393 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 52848, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 215328 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.394 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.395 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.396 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.398 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-19T09:17:35.399 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.400 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.402 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-19T09:17:35.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.404 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.405 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 2, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-09-19T09:17:35.406 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 2920, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:35.407 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:35.408 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:35.409 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 189393, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 51, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 187, 2024-09-19T09:17:35.410 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 1901912, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 5723, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-19T09:17:35.411 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 3371, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 21, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 3, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 3371, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3371, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 7.063834457, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002095471 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3371, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 3372 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.412 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 3371, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 3371, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 1847, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 1522, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-19T09:17:35.413 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 1, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-19T09:17:35.414 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-19T09:17:35.415 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 109, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 22, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 5, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 7, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 2, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-19T09:17:35.416 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-19T09:17:35.417 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 3726, 2024-09-19T09:17:35.418 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 10919338, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 3726, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3726, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 10919338, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:35.419 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 3371, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 8464605, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3371, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 8464605, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.420 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 3371, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 3371, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3371, 2024-09-19T09:17:35.421 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 3371, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:35.422 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55e103de2b40": { 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:35.423 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:35.425 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-19T09:17:35.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:35 smithi184 ceph-mon[35007]: pgmap v459: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:35.940 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:35 smithi122 ceph-mon[34247]: pgmap v459: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:35.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:35 smithi083 ceph-mon[30926]: pgmap v459: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:36.355 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:36.356 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-19T09:17:36.356 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:17:36.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:17:36.616 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:17:37.156 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-19T09:17:37.156 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:37.156 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 2164, 2024-09-19T09:17:37.156 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 3472, 2024-09-19T09:17:37.156 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 810944, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1874004, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 15, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.175581465, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.061265562, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.107742897, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.011841746, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3469, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.420993520, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000121358 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.157 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4488, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000893335, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000199 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 4576, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 1888 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 4054, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 4127, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 3399544, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 2100576, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 9, 2024-09-19T09:17:37.158 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.316473678, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.131976034, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.200550477, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.018097805, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4128, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.259492921, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000062861 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 6520, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001044465, 2024-09-19T09:17:37.159 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000160 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1886240, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 180800 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1392, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1614, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 876620, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 3036782, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 15, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.123621628, 2024-09-19T09:17:37.160 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.044204289, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.055915351, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.024332140, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1611, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.180077545, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000111779 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1401, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000278697, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000198 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.161 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3936, 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 545792 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:37.162 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 747, 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.360607701, 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000482741 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 886, 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.039728824, 2024-09-19T09:17:37.163 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000044840 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 708, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 646, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 646, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 26.866929787, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.041589674 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 62, 2024-09-19T09:17:37.164 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 258, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 2, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 4, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 252, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 255, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 415, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 2, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 2, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 4, 2024-09-19T09:17:37.165 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 1589, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 1126, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 59, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 90, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 8, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 347, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 8, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 284, 2024-09-19T09:17:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 44, 2024-09-19T09:17:37.167 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 221, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 358, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 437, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 172, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 7, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 386 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 25, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 300, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 193, 2024-09-19T09:17:37.168 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 219, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 40, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 59, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 181, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 122, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-19T09:17:37.169 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 8, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 837, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-19T09:17:37.170 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 837, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 2, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 5949493, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 296, 2024-09-19T09:17:37.171 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 7.828877382, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.026448910 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 141, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 457, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 316, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 79, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 163, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 84, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 258, 2024-09-19T09:17:37.172 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 795, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 537, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 2, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 191, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 189, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 59040, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 223520 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 1356, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 7, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 708, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 26, 2024-09-19T09:17:37.173 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 163, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 10, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.021652882, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002165288 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 180, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.136666070, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000759255 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.174 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 186, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 24.699658196, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.132793861 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.175 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:37.176 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.177 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.178 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.178 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-19T09:17:37.179 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 82, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.056950953, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000694523 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 7, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.004863676, 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000694810 2024-09-19T09:17:37.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 7, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.026543206, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.003791886 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.181 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 59, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.524015751, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.025830775 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.182 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:37.183 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 115, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.396579053, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.003448513 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:37.185 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.186 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.186 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.186 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-19T09:17:37.186 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-09-19T09:17:37.187 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 3, 2024-09-19T09:17:37.187 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-09-19T09:17:37.187 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-09-19T09:17:37.187 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-19T09:17:37.187 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 457, 2024-09-19T09:17:37.187 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 228, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 846, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:37.188 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:37.189 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-19T09:17:37.190 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 772778, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 241, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:37.191 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 187, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 712914, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 19960, 2024-09-19T09:17:37.192 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 1345, 2024-09-19T09:17:37.193 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 1804813, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 28, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 1345, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1345, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 100.906644972, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.075023527 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1345, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1472 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 1345, 2024-09-19T09:17:37.194 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 9, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 1336, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 9, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 305, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 43, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 870, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-19T09:17:37.195 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-19T09:17:37.196 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-19T09:17:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 109, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 22, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 13, 2024-09-19T09:17:37.198 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 1, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 165, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 50 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-19T09:17:37.199 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 60, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 5, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 858, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 122, 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:37.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 7606, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 4379443, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 7606, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:37.201 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 7606, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 4379443, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:37.202 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:37.203 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:37.203 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:37.203 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:37.203 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 1345, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 1823615, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1345, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1823615, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:37.204 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 1345, 2024-09-19T09:17:37.205 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 1345, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1345, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1345, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:37.206 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 122, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 18802, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 122, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 9, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 18802, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.207 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55cd130b8960": { 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 837, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1755189, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 837, 2024-09-19T09:17:37.208 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:37.209 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:37.209 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 296, 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1755189, 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:37.211 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-19T09:17:37.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:37 smithi122 ceph-mon[34247]: pgmap v460: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 472 B/s wr, 9 op/s 2024-09-19T09:17:37.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:37 smithi184 ceph-mon[35007]: pgmap v460: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 472 B/s wr, 9 op/s 2024-09-19T09:17:37.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:37 smithi083 ceph-mon[30926]: pgmap v460: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 472 B/s wr, 9 op/s 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds.exported=8 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds.imported=8 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=25 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=300 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:38.075 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T09:17:38.075 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:17:38.076 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:17:38.324 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:17:39.053 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1312, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1266, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2196048, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 483338, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 1, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.154761164, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.059832671, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.071746578, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.028389984, 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:39.054 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1265, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.066097568, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000052251 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1875168, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 179648 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.055 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 5, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 220, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1710, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 531646, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 9, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.012361344, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.007907099, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.002337360, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000065405, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 217, 2024-09-19T09:17:39.056 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.020371158, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000093876 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 530624 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1936, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1935, 2024-09-19T09:17:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1361888, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 614507, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 6, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.133846517, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.037534693, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.037343728, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.049875193, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1934, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.069763262, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000036072 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-19T09:17:39.059 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4902, 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.111383928, 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000022722 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-19T09:17:39.060 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.061 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 29, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 29, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 29, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:39.062 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 1, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-09-19T09:17:39.063 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:39.064 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-19T09:17:39.065 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:39.066 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-09-19T09:17:39.067 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 644, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-19T09:17:39.068 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 5061575, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 5054464, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 644 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 4, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 183, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 179, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 2, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 21, 2024-09-19T09:17:39.069 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 19, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 29, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 208, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 179, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 49448, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 215328 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-09-19T09:17:39.070 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.071 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.072 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.074 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-19T09:17:39.075 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-19T09:17:39.076 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.080 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.081 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.082 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 3, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 3, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 2413, 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:39.084 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 198167, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 53, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:39.086 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 187, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 34144, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 148, 2024-09-19T09:17:39.087 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 2889, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 21, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 3, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 2889, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2889, 2024-09-19T09:17:39.088 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 33.499215837, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.011595436 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2889, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 2890 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 2889, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 2889, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 1807, 2024-09-19T09:17:39.089 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 1080, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 1, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-09-19T09:17:39.090 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-19T09:17:39.091 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-19T09:17:39.092 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 109, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 22, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 6, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 9, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 3, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-09-19T09:17:39.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:17:39.094 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 3249, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 3246101, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 3249, 2024-09-19T09:17:39.095 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3249, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 3246101, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:39.096 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2889, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 867276, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2889, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 867276, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.097 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 2889, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 2889, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2889, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 2889, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.098 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:39.099 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55f357abcb40": { 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-19T09:17:39.100 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-19T09:17:39.101 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-19T09:17:39.750 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:39 smithi122 ceph-mon[34247]: pgmap v461: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-19T09:17:39.777 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T09:17:39.777 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T09:17:39.777 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-19T09:17:39.778 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-19T09:17:39.778 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-19T09:17:39.778 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:39.778 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:39.778 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-19T09:17:39.778 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:17:39.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:17:39.863 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:39 smithi184 ceph-mon[35007]: pgmap v461: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-19T09:17:39.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:39 smithi083 ceph-mon[30926]: pgmap v461: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-19T09:17:40.160 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:17:40.979 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 692, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 676, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1965855, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 366204, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 19, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 9, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.091419164, 2024-09-19T09:17:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.027807127, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.065225633, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.011071062, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 669, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.047373692, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000070812 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 63, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000011105, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000176 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 1889264, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 194064 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 5756, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 4475, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2691985, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 3252771, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 10, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.392446609, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.131410173, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.256249097, 2024-09-19T09:17:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.052331310, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4477, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.340903772, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000076145 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 8425, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001498415, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000177 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 126416 2024-09-19T09:17:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 578, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 750, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 298705, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 794006, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 11, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.063492850, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.019629313, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.021690744, 2024-09-19T09:17:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.019448676, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 750, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.076817481, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000102423 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 198, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000047399, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000239 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 403680 2024-09-19T09:17:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 498, 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.135216215, 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000271518 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1108, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.042087032, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000037984 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 364, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 292, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 292, 2024-09-19T09:17:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 102.315098168, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.350394171 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 72, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 19, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 1, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 11, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 1, 2024-09-19T09:17:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 10, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 10, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 349, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 2, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 748, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 551, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 72, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 88, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-19T09:17:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 8, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 169, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 1, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 40, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 181, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 152, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 493, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 225, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 13, 2024-09-19T09:17:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 56 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 337, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 211, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 255, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 28, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 28, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 8, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 1, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-19T09:17:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 644, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 644, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 2, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 2, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-09-19T09:17:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 5061575, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 176, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 156.910647159, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.891537767 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 17, 2024-09-19T09:17:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 282, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 265, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 13, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 173, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 160, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 11, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 388, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 377, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 44, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 44, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 58948, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223520 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 418, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 7, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 364, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 26, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 44, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-09-19T09:17:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000240474, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000240474 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 116, 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 7.649100442, 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.065940521 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-19T09:17:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 131, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 94.609945450, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.722213324 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 16, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.008526546, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000532909 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 28, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.047285256, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001688759 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-19T09:17:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 2, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 3, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 2, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 107, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 53, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 848, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 290227, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 117, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 187, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 70856, 2024-09-19T09:17:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 265, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 1437, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 955285, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 33, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 1437, 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-19T09:17:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1437, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 276.046040885, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.192098845 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1437, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1573 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 1437, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 1, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 1436, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-19T09:17:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 177, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 32, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 1105, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 0, 2024-09-19T09:17:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-19T09:17:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-19T09:17:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 109, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 22, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 14, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 2, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 173, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 0, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 55 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-09-19T09:17:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 4 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 52, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 1, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 1092, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 28, 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 7022, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 4301387, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 7022, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 7022, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 4301387, 2024-09-19T09:17:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1437, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 959681, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1437, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 959681, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1437, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1437, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1437, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1437, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 28, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 4396, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 28, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 4396, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55aecdb70960": { 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 644, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 867271, 2024-09-19T09:17:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 644, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 176, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 867271, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:41.030 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-19T09:17:41.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:41 smithi184 ceph-mon[35007]: pgmap v462: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:17:41.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:41 smithi122 ceph-mon[34247]: pgmap v462: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:17:41.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:41 smithi083 ceph-mon[30926]: pgmap v462: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds.exported=8 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=337 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:41.998 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=1 2024-09-19T09:17:41.998 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:17:41.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:17:42.257 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:17:42.871 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-19T09:17:42.871 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:42.871 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1431, 2024-09-19T09:17:42.871 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1383, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 6417122, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 519236, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 1, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.169609182, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.054656572, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.085129786, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.035764684, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1383, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.078677168, 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000056888 2024-09-19T09:17:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 1877504, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 178336 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1192, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1400, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 4102990, 2024-09-19T09:17:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 908784, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 7, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.110926575, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.037163351, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.028452574, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.036733753, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1397, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.084643633, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000060589 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.874 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 531888 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 614, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 616, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 4351246, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 195259, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 4, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.052473018, 2024-09-19T09:17:42.875 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.019971662, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.013865241, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.013760234, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 614, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.022297407, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000036314 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.876 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4792, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.121349580, 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000025323 2024-09-19T09:17:42.877 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-19T09:17:42.878 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 1193, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 1193, 2024-09-19T09:17:42.879 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 1193, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 2, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-19T09:17:42.880 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 6, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:42.881 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2024-09-19T09:17:42.882 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2024-09-19T09:17:42.883 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:42.884 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 4488, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 6, 2024-09-19T09:17:42.885 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 16383362, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 16378392, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 4488 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 172, 2024-09-19T09:17:42.886 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 1090, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 918, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 35, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 130, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 95, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 1193, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1684, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 491, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 53032, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 215328 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.887 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.888 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.889 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.890 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:42.891 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.892 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.894 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.895 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-19T09:17:42.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.897 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 2, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 6, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 4, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 4, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 2950, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:42.900 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:42.901 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:42.902 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:42.903 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 189410, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 52, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 187, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:42.904 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 1349251, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 8784, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-19T09:17:42.905 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 2871, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 26, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 4, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 2871, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2871, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 123.727332856, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.043095553 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2871, 2024-09-19T09:17:42.906 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2872 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 2871, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 2871, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 1736, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1132, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-19T09:17:42.907 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-09-19T09:17:42.908 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-09-19T09:17:42.908 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2024-09-19T09:17:42.908 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-19T09:17:42.908 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 2, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:42.909 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-19T09:17:42.910 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 109, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 22, 2024-09-19T09:17:42.911 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 5, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 5, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.912 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:42.913 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 3233, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 14559363, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 3233, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3233, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 14559363, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2871, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 12189068, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2871, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 12189068, 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:42.915 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2871, 2024-09-19T09:17:42.916 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 2871, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2871, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2871, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:42.917 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55a111216b40": { 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:42.918 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.919 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:42.920 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-19T09:17:43.861 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:43 smithi184 ceph-mon[35007]: pgmap v463: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:17:43.861 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:43 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:43.861 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:43 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:43.861 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:43 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:43.861 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:43 smithi184 ceph-mon[35007]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:43.888 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-19T09:17:43.889 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:17:43.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:17:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:43 smithi122 ceph-mon[34247]: pgmap v463: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:17:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:43 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:43 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:43.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:43 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:43.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:43 smithi122 ceph-mon[34247]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:17:43.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:43 smithi083 ceph-mon[30926]: pgmap v463: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-19T09:17:43.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:43 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:43.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:43 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:43.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:43 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:43.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:43 smithi083 ceph-mon[30926]: from='mgr.15288 ' entity='mgr.x' 2024-09-19T09:17:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:17:44.703 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-19T09:17:44.703 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:44.703 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 922, 2024-09-19T09:17:44.703 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1234, 2024-09-19T09:17:44.703 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 543232, 2024-09-19T09:17:44.703 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 1170425, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 12, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.090501857, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.028552881, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.039405754, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.019900601, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1234, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.112403680, 2024-09-19T09:17:44.704 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000091088 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 927, 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000187546, 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000202 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 405472 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:44.705 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 5066, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 4715, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2332742, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 10929404, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 13, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 7, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.375330324, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.136103200, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.196262305, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.060374395, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4713, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.216023411, 2024-09-19T09:17:44.706 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000045835 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6350, 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001098227, 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000172 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 4992, 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 131168 2024-09-19T09:17:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 3404, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 5246, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 3163625, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 2462463, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 12, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 7, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.367310339, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.143682981, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.250674103, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.016778365, 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:44.708 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5243, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.252308315, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000048122 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6562, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001351961, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000206 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 1891136, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 184336 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-19T09:17:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2878, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.547247887, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000190148 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 952, 2024-09-19T09:17:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.038162351, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000040086 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 589, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 460, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 460, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 49.671251378, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.107980981 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-19T09:17:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 129, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 2, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 28, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 2, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 753, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 112, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 629, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 12, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 589, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 447, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 2, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 2, 2024-09-19T09:17:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 4, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 992, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 692, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 104, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 98, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 2, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 12, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 384, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 17, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 861, 2024-09-19T09:17:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:44.714 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 6, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 137, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 1196, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 1493, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 1301, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 2, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 177 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 66, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 288, 2024-09-19T09:17:44.715 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 192, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 199, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 108, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 2, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 28, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 26, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-19T09:17:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 12, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 2, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 1822, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-19T09:17:44.717 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 1822, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 5, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 5, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 12658904, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-09-19T09:17:44.718 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1239, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 5.820765363, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.004697954 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 630, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 1001, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 371, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 43, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 157, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 114, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 753, 2024-09-19T09:17:44.719 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1226, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 473, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 2, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 296, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 294, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 59084, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223520 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 663, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 140, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 589, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 25, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 292, 2024-09-19T09:17:44.720 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 119, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.148987887, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001251999 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 8, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.002553179, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000319147 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 159, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 17.327847636, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.108980173 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.722 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.723 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-19T09:17:44.724 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-19T09:17:44.725 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 127, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 32.124766947, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.252950920 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.726 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 19, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.007644741, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000402354 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.727 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.023469481, 2024-09-19T09:17:44.728 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.011734740 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-19T09:17:44.731 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.732 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 26, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.035981507, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001383904 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.733 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 101, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 101, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 885, 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:44.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:44.735 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:44.736 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:44.737 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 336257, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 117, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:44.738 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 187, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 1967581, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 7989, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-19T09:17:44.739 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 2596, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 8693429, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 32, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 2596, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2596, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 118.794428670, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.045760565 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.740 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2596, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2996 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 2596, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 5, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 2591, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1, 2024-09-19T09:17:44.741 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 1240, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 58, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 1, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 951, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:44.742 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-19T09:17:44.743 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 109, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 22, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-09-19T09:17:44.744 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 13, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 1, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 540, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 6, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 169 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-19T09:17:44.745 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 4 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 52, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 1, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 936, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 26, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:44.746 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 9388, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 5171890, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 9388, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 9388, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 5171890, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.747 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2596, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 8697401, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2596, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 8697401, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.748 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2596, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 2596, 2024-09-19T09:17:44.749 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2596, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2596, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 26, 2024-09-19T09:17:44.750 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 4066, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 26, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 4066, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55ee43332960": { 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:44.751 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 1822, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 8464600, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 1822, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1239, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 8464600, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:44.752 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.753 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:44.753 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-19T09:17:45.759 INFO:tasks.check_counter:Daemon mds.i mds.exported=12 2024-09-19T09:17:45.759 INFO:tasks.check_counter:Daemon mds.i mds.imported=17 2024-09-19T09:17:45.760 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=66 2024-09-19T09:17:45.760 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=288 2024-09-19T09:17:45.760 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-09-19T09:17:45.760 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:45.760 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:45.760 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=2 2024-09-19T09:17:45.760 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:17:45.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:17:45.786 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:45 smithi184 ceph-mon[35007]: pgmap v464: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:17:45.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:45 smithi122 ceph-mon[34247]: pgmap v464: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:17:45.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:45 smithi083 ceph-mon[30926]: pgmap v464: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:17:46.009 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:17:46.546 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1040, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1041, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2027180, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 330471, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 7, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.091120045, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.025318906, 2024-09-19T09:17:46.547 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.027422115, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.029707646, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1039, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.044555573, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000042883 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:17:46.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1175, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1129, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2076470, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 440416, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.123338100, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.036241609, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.069536401, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.029047155, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1128, 2024-09-19T09:17:46.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.050181251, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000044486 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 1875712, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 180928 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 909, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1124, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 306720, 2024-09-19T09:17:46.550 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 821810, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.110861880, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.038149364, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.029342262, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.032073491, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1122, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.071913671, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000064094 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:17:46.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 534656 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-19T09:17:46.552 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4641, 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.127161251, 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000027399 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-19T09:17:46.553 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 365, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 365, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-09-19T09:17:46.555 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 365, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 1, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:17:46.556 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 0, 2024-09-19T09:17:46.557 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:17:46.558 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-19T09:17:46.559 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:17:46.560 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 837, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-19T09:17:46.561 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 2, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 5949493, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 5946459, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.562 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 837 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 124, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 416, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 292, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 61, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 85, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 24, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 365, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 736, 2024-09-19T09:17:46.563 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 371, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 52056, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 215328 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-19T09:17:46.564 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.566 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.567 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.568 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-19T09:17:46.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.569 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.569 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.570 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-19T09:17:46.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.573 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.574 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-19T09:17:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.576 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 2, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 3, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 2, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1920, 2024-09-19T09:17:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:17:46.578 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:17:46.579 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 190195, 2024-09-19T09:17:46.580 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 54, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 9296, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 187, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-19T09:17:46.581 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 672733, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 18632, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 2758, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 21, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 3, 2024-09-19T09:17:46.582 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 2758, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2758, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 89.976060026, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.032623662 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2758, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2759 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 2758, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 2758, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2024-09-19T09:17:46.583 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 1718, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1038, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-19T09:17:46.584 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-19T09:17:46.585 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-19T09:17:46.586 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 109, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 22, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 5, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 7, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 2, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-19T09:17:46.587 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:17:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 0, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 3120, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 4108331, 2024-09-19T09:17:46.589 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 3120, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3120, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 4108331, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2758, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1755194, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2758, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1755194, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2758, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 2758, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2758, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2758, 2024-09-19T09:17:46.592 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:46.593 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x556fbe646b40": { 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-19T09:17:46.594 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-19T09:17:46.595 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-19T09:17:47.269 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T09:17:47.269 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T09:17:47.269 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-19T09:17:47.269 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-19T09:17:47.269 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-19T09:17:47.270 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-19T09:17:47.270 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T09:17:47.270 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-19T09:17:47.270 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T09:17:47.281 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T09:17:47.281 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:17:47.281 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:47.311 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:17:47.311 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:47.370 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:17:47.667 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:47.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:47 smithi083 ceph-mon[30926]: pgmap v465: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:47.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:47 smithi184 ceph-mon[35007]: pgmap v465: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:47.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:47 smithi122 ceph-mon[34247]: pgmap v465: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:48.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2496433135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 msgr2=0x7f9cf810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2496433135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf810da40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009ca0 tx=0x7f9cf002a950 comp rx=0 tx=0).stop 2024-09-19T09:17:48.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2496433135 shutdown_connections 2024-09-19T09:17:48.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2496433135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf810da40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2496433135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cf8102570 0x7f9cf81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2496433135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf8100e20 0x7f9cf8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2496433135 >> 172.21.15.83:0/2496433135 conn(0x7f9cf80fc7d0 msgr2=0x7f9cf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2496433135 shutdown_connections 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.149+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2496433135 wait complete. 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 Processor -- start 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 -- start start 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cf8100e20 0x7f9cf8197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf8102570 0x7f9cf8197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8110e30 con 0x7f9cf8102ef0 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8110cb0 con 0x7f9cf8100e20 2024-09-19T09:17:48.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfebd3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8110fb0 con 0x7f9cf8102570 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfd170640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfd170640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf819bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37046/0 (socket says 172.21.15.83:37046) 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfd170640 1 -- 172.21.15.83:0/2095841070 learned_addr learned my addr 172.21.15.83:0/2095841070 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.150+0000 7f9cfc96f640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cf8100e20 0x7f9cf8197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cf7fff640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf8102570 0x7f9cf8197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfd170640 1 -- 172.21.15.83:0/2095841070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf8102570 msgr2=0x7f9cf8197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfd170640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf8102570 0x7f9cf8197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfd170640 1 -- 172.21.15.83:0/2095841070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cf8100e20 msgr2=0x7f9cf8197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfd170640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cf8100e20 0x7f9cf8197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfd170640 1 -- 172.21.15.83:0/2095841070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf819c300 con 0x7f9cf8102ef0 2024-09-19T09:17:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfd170640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf819bc20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004af0 tx=0x7f9cf002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0034040 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf819c590 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9cf00308f0 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0004670 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.151+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf819ca60 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.152+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf8101200 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.153+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9cf0037020 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.154+0000 7f9cf5ffb640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f9ce80a33b0 0x7f9ce80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.154+0000 7f9cfc96f640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f9ce80a33b0 0x7f9ce80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.154+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9394+0+0 (secure 0 0 0) 0x7f9cf00f27c0 con 0x7f9cf8102ef0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.154+0000 7f9cfc96f640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f9ce80a33b0 0x7f9ce80a5870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9cec005fd0 tx=0x7f9cec00b390 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:48.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.158+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9cf0040070 con 0x7f9cf8102ef0 2024-09-19T09:17:48.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.341+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9cf8108b90 con 0x7f9cf8102ef0 2024-09-19T09:17:48.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.341+0000 7f9cf5ffb640 1 -- 172.21.15.83:0/2095841070 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v109) ==== 81+0+944 (secure 0 0 0) 0x7f9cf00be7e0 con 0x7f9cf8102ef0 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/2542755280 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/931956178 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/2542755280 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3669863104 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3719562585 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4167999844 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4197257925 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:48.343 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4071352347 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:48.344 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3215219814 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:48.344 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:48.344 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/512658189 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:48.344 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1998970001 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:48.344 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3109717577 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:48.344 INFO:teuthology.orchestra.run.smithi083.stderr:listed 16 entries 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f9ce80a33b0 msgr2=0x7f9ce80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f9ce80a33b0 0x7f9ce80a5870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9cec005fd0 tx=0x7f9cec00b390 comp rx=0 tx=0).stop 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 msgr2=0x7f9cf819bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf819bc20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004af0 tx=0x7f9cf002f5d0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 shutdown_connections 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9cf8102ef0 0x7f9cf819bc20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f9ce80a33b0 0x7f9ce80a5870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf8102570 0x7f9cf8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 --2- 172.21.15.83:0/2095841070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cf8100e20 0x7f9cf8197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 >> 172.21.15.83:0/2095841070 conn(0x7f9cf80fc7d0 msgr2=0x7f9cf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:48.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 shutdown_connections 2024-09-19T09:17:48.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:48.344+0000 7f9cfebd3640 1 -- 172.21.15.83:0/2095841070 wait complete. 2024-09-19T09:17:48.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:48 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2095841070' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:17:48.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:48 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2095841070' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:17:48.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:48 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2095841070' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:17:49.343 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-19T09:17:49.343 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:49.363 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:17:49.662 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:49.665 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:49 smithi083 ceph-mon[30926]: pgmap v466: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-19T09:17:49.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:49 smithi184 ceph-mon[35007]: pgmap v466: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-19T09:17:49.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:49 smithi122 ceph-mon[34247]: pgmap v466: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-19T09:17:50.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 -- 172.21.15.83:0/115162488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9801036e0 msgr2=0x7fc980107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 --2- 172.21.15.83:0/115162488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9801036e0 0x7fc980107b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc968009930 tx=0x7fc96802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 -- 172.21.15.83:0/115162488 shutdown_connections 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 --2- 172.21.15.83:0/115162488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 0x7fc98010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 --2- 172.21.15.83:0/115162488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9801036e0 0x7fc980107b90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 --2- 172.21.15.83:0/115162488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc980102d30 0x7fc980103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 -- 172.21.15.83:0/115162488 >> 172.21.15.83:0/115162488 conn(0x7fc9800fc7d0 msgr2=0x7fc9800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 -- 172.21.15.83:0/115162488 shutdown_connections 2024-09-19T09:17:50.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 -- 172.21.15.83:0/115162488 wait complete. 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 Processor -- start 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.168+0000 7fc986348640 1 -- start start 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc986348640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 0x7fc980198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc986348640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9801036e0 0x7fc980198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc986348640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 0x7fc98019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc986348640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc980111f50 con 0x7fc980102d30 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc986348640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc980111dd0 con 0x7fc9801082a0 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc986348640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9801120d0 con 0x7fc9801036e0 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 0x7fc980198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 0x7fc980198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54218/0 (socket says 172.21.15.83:54218) 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 -- 172.21.15.83:0/2350241168 learned_addr learned my addr 172.21.15.83:0/2350241168 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97f7fe640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9801036e0 0x7fc980198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc9848e5640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 0x7fc98019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 -- 172.21.15.83:0/2350241168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9801036e0 msgr2=0x7fc980198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9801036e0 0x7fc980198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 -- 172.21.15.83:0/2350241168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 msgr2=0x7fc98019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 0x7fc98019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 -- 172.21.15.83:0/2350241168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98019d4d0 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc9848e5640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 0x7fc98019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97ffff640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 0x7fc980198520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c970 tx=0x7fc97000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.169+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970007bb0 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.170+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98019d7c0 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.170+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc970007d50 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.170+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97000f450 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.170+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801a50a0 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.171+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98006a850 con 0x7fc980102d30 2024-09-19T09:17:50.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.172+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc970004f20 con 0x7fc980102d30 2024-09-19T09:17:50.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.172+0000 7fc97d7fa640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc96c0a33b0 0x7fc96c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.172+0000 7fc97f7fe640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc96c0a33b0 0x7fc96c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.172+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9394+0+0 (secure 0 0 0) 0x7fc9700cfe10 con 0x7fc980102d30 2024-09-19T09:17:50.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.173+0000 7fc97f7fe640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc96c0a33b0 0x7fc96c0a5870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc968031440 tx=0x7fc968000bc0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:50.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.176+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc970014030 con 0x7fc980102d30 2024-09-19T09:17:50.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.362+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc98010a2b0 con 0x7fc980102d30 2024-09-19T09:17:50.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.363+0000 7fc97d7fa640 1 -- 172.21.15.83:0/2350241168 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v109) ==== 81+0+944 (secure 0 0 0) 0x7fc97009c480 con 0x7fc980102d30 2024-09-19T09:17:50.364 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/2542755280 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:50.364 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/931956178 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/2542755280 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3669863104 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3719562585 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4167999844 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/3693558817 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4197257925 2024-09-20T08:53:19.429460+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4071352347 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3215219814 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1883694223 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/512658189 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:50.365 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1998970001 2024-09-20T08:53:42.831703+0000 2024-09-19T09:17:50.366 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3109717577 2024-09-20T09:03:00.037901+0000 2024-09-19T09:17:50.366 INFO:teuthology.orchestra.run.smithi083.stderr:listed 16 entries 2024-09-19T09:17:50.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc96c0a33b0 msgr2=0x7fc96c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc96c0a33b0 0x7fc96c0a5870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc968031440 tx=0x7fc968000bc0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 msgr2=0x7fc980198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 0x7fc980198520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c970 tx=0x7fc97000ce30 comp rx=0 tx=0).stop 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 shutdown_connections 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9801082a0 0x7fc98019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fc96c0a33b0 0x7fc96c0a5870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9801036e0 0x7fc980198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 --2- 172.21.15.83:0/2350241168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc980102d30 0x7fc980198520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 >> 172.21.15.83:0/2350241168 conn(0x7fc9800fc7d0 msgr2=0x7fc980105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 shutdown_connections 2024-09-19T09:17:50.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:50.365+0000 7fc986348640 1 -- 172.21.15.83:0/2350241168 wait complete. 2024-09-19T09:17:50.852 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:50 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2350241168' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:17:50.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:50 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2350241168' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:17:50.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:50 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2350241168' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:17:51.265 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-09-19T09:17:51.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:51.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T09:17:51.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:17:51.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[83249]: fuse finished with error 0 and tester_r 0 2024-09-19T09:17:51.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:51 smithi083 ceph-mon[30926]: pgmap v467: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:17:51.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:51 smithi184 ceph-mon[35007]: pgmap v467: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:17:51.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:51 smithi122 ceph-mon[34247]: pgmap v467: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T09:17:53.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:53 smithi184 ceph-mon[35007]: pgmap v468: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:17:53.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:53 smithi122 ceph-mon[34247]: pgmap v468: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:17:53.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:53 smithi083 ceph-mon[30926]: pgmap v468: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:17:55.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:55 smithi184 ceph-mon[35007]: pgmap v469: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:55.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:55 smithi122 ceph-mon[34247]: pgmap v469: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:55.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:55 smithi083 ceph-mon[30926]: pgmap v469: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T09:17:57.405 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:17:57.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:57.405 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:17:57.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:57.425 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-19T09:17:57.515 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:17:57.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:57.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:17:57.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:57.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-19T09:17:57.651 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:17:57.663 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:17:57.663 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:17:57.663 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:57.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:57 smithi184 ceph-mon[35007]: pgmap v470: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-19T09:17:57.919 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:57.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:57 smithi122 ceph-mon[34247]: pgmap v470: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-19T09:17:57.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:57 smithi083 ceph-mon[30926]: pgmap v470: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 -- 172.21.15.83:0/1685426936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc102790 msgr2=0x7f40cc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 --2- 172.21.15.83:0/1685426936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc102790 0x7f40cc1067e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009900 tx=0x7f40c802a410 comp rx=0 tx=0).stop 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 -- 172.21.15.83:0/1685426936 shutdown_connections 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 --2- 172.21.15.83:0/1685426936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40cc106f10 0x7f40cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 --2- 172.21.15.83:0/1685426936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc102790 0x7f40cc1067e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 --2- 172.21.15.83:0/1685426936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40cc101de0 0x7f40cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 -- 172.21.15.83:0/1685426936 >> 172.21.15.83:0/1685426936 conn(0x7f40cc0fd8c0 msgr2=0x7f40cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 -- 172.21.15.83:0/1685426936 shutdown_connections 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.422+0000 7f40d4706640 1 -- 172.21.15.83:0/1685426936 wait complete. 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 Processor -- start 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 -- start start 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 0x7f40cc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40cc102790 0x7f40cc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40cc106f10 0x7f40cc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc111e20 con 0x7f40cc101de0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc111ca0 con 0x7f40cc102790 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d4706640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc111fa0 con 0x7f40cc106f10 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d24a2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 0x7f40cc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d24a2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 0x7f40cc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54224/0 (socket says 172.21.15.83:54224) 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d24a2640 1 -- 172.21.15.83:0/3127626175 learned_addr learned my addr 172.21.15.83:0/3127626175 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d2ca3640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40cc106f10 0x7f40cc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.423+0000 7f40d1ca1640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40cc102790 0x7f40cc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d24a2640 1 -- 172.21.15.83:0/3127626175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40cc106f10 msgr2=0x7f40cc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d24a2640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40cc106f10 0x7f40cc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d24a2640 1 -- 172.21.15.83:0/3127626175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40cc102790 msgr2=0x7f40cc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d24a2640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40cc102790 0x7f40cc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d24a2640 1 -- 172.21.15.83:0/3127626175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc19d370 con 0x7f40cc101de0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d24a2640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 0x7f40cc1983c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c890 tx=0x7f40c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0004220 con 0x7f40cc101de0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc19d660 con 0x7f40cc101de0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40c00043c0 con 0x7f40cc101de0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0004a00 con 0x7f40cc101de0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.424+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc1a4f40 con 0x7f40cc101de0 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.425+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40cc1021c0 con 0x7f40cc101de0 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.426+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f40c0004ba0 con 0x7f40cc101de0 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.427+0000 7f40bf7fe640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f40b80a33b0 0x7f40b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.427+0000 7f40d1ca1640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f40b80a33b0 0x7f40b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.427+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9394+0+0 (secure 0 0 0) 0x7f40c00d0130 con 0x7f40cc101de0 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.427+0000 7f40d1ca1640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f40b80a33b0 0x7f40b80a5870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40c8031440 tx=0x7f40c80095f0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:58.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.430+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40c0014030 con 0x7f40cc101de0 2024-09-19T09:17:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.631+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40cc10a1b0 con 0x7f40cc101de0 2024-09-19T09:17:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.632+0000 7f40bf7fe640 1 -- 172.21.15.83:0/3127626175 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+12006 (secure 0 0 0) 0x7f40c009c7a0 con 0x7f40cc101de0 2024-09-19T09:17:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:17:58.634 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":60,"btime":"2024-09-19T09:17:06:657640+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:17:06.104720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24445,24443,24430,24476,14583]},"id":1}]} 2024-09-19T09:17:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 60 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f40b80a33b0 msgr2=0x7f40b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f40b80a33b0 0x7f40b80a5870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40c8031440 tx=0x7f40c80095f0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 msgr2=0x7f40cc1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 0x7f40cc1983c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c890 tx=0x7f40c000cd50 comp rx=0 tx=0).stop 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 shutdown_connections 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f40b80a33b0 0x7f40b80a5870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40cc106f10 0x7f40cc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40cc102790 0x7f40cc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 --2- 172.21.15.83:0/3127626175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40cc101de0 0x7f40cc1983c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 >> 172.21.15.83:0/3127626175 conn(0x7f40cc0fd8c0 msgr2=0x7f40cc0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 shutdown_connections 2024-09-19T09:17:58.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:17:58.634+0000 7f40d4706640 1 -- 172.21.15.83:0/3127626175 wait complete. 2024-09-19T09:17:59.480 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:59.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:59 smithi083 ceph-mon[30926]: pgmap v471: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-19T09:17:59.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:17:59 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3127626175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:59.729 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:59.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:59 smithi184 ceph-mon[35007]: pgmap v471: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-19T09:17:59.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:17:59 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3127626175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:59.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:59 smithi122 ceph-mon[34247]: pgmap v471: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-19T09:17:59.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:17:59 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3127626175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 -- 172.21.15.83:0/2532367229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900105500 msgr2=0x7f590010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 --2- 172.21.15.83:0/2532367229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900105500 0x7f590010d080 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009ca0 tx=0x7f58f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 -- 172.21.15.83:0/2532367229 shutdown_connections 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 --2- 172.21.15.83:0/2532367229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900105500 0x7f590010d080 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 --2- 172.21.15.83:0/2532367229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5900100c70 0x7f5900104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 --2- 172.21.15.83:0/2532367229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59001002c0 0x7f59001006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 -- 172.21.15.83:0/2532367229 >> 172.21.15.83:0/2532367229 conn(0x7f5900077010 msgr2=0x7f59000fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 -- 172.21.15.83:0/2532367229 shutdown_connections 2024-09-19T09:18:00.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.206+0000 7f59049a2640 1 -- 172.21.15.83:0/2532367229 wait complete. 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 Processor -- start 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 -- start start 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59001002c0 0x7f5900198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 0x7f59001987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5900105500 0x7f590019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f590010fb90 con 0x7f5900100c70 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f590010fa10 con 0x7f5900105500 2024-09-19T09:18:00.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f59049a2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f590010fd10 con 0x7f59001002c0 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 0x7f59001987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 0x7f59001987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47736/0 (socket says 172.21.15.83:47736) 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f58f7fff640 1 -- 172.21.15.83:0/3164269584 learned_addr learned my addr 172.21.15.83:0/3164269584 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f58ff7fe640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59001002c0 0x7f5900198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.207+0000 7f58fffff640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5900105500 0x7f590019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58f7fff640 1 -- 172.21.15.83:0/3164269584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59001002c0 msgr2=0x7f5900198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58f7fff640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59001002c0 0x7f5900198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58f7fff640 1 -- 172.21.15.83:0/3164269584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5900105500 msgr2=0x7f590019cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58f7fff640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5900105500 0x7f590019cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58f7fff640 1 -- 172.21.15.83:0/3164269584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590019d210 con 0x7f5900100c70 2024-09-19T09:18:00.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58f7fff640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 0x7f59001987a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f58e800d950 tx=0x7f58e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8017070 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58e8009c30 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590019d500 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e800f620 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.208+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59001a4de0 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.209+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59001017a0 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.210+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f58e80109a0 con 0x7f5900100c70 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.211+0000 7f58fd7fa640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f58ec0a33b0 0x7f58ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.211+0000 7f58ff7fe640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f58ec0a33b0 0x7f58ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.211+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9394+0+0 (secure 0 0 0) 0x7f58e80cfc50 con 0x7f5900100c70 2024-09-19T09:18:00.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.211+0000 7f58ff7fe640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f58ec0a33b0 0x7f58ec0a5870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005d00 tx=0x7f58f000b510 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:00.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.214+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58e8009de0 con 0x7f5900100c70 2024-09-19T09:18:00.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.420+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59001086e0 con 0x7f5900100c70 2024-09-19T09:18:00.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.421+0000 7f58fd7fa640 1 -- 172.21.15.83:0/3164269584 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+12006 (secure 0 0 0) 0x7f58e809c2c0 con 0x7f5900100c70 2024-09-19T09:18:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:18:00.423 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":60,"btime":"2024-09-19T09:17:06:657640+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14508,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/3427826085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3427826085},{"type":"v1","addr":"172.21.15.83:6835","nonce":3427826085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1285159931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":1285159931},{"type":"v1","addr":"172.21.15.83:6837","nonce":1285159931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:00:37.699557+0000","modified":"2024-09-19T09:17:06.104720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24445,"mds_2":24443,"mds_3":24430,"mds_4":14583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14577":{"gid":14577,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6839/37046716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":37046716},{"type":"v1","addr":"172.21.15.83:6839","nonce":37046716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.83:6841/2224605516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":2224605516},{"type":"v1","addr":"172.21.15.83:6841","nonce":2224605516}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/3460261556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3460261556},{"type":"v1","addr":"172.21.15.122:6833","nonce":3460261556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/2584272411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2584272411},{"type":"v1","addr":"172.21.15.184:6833","nonce":2584272411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/2324915489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2324915489},{"type":"v1","addr":"172.21.15.122:6835","nonce":2324915489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1361922279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1361922279},{"type":"v1","addr":"172.21.15.184:6835","nonce":1361922279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":17,"addr":"172.21.15.184:6837/236760278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":236760278},{"type":"v1","addr":"172.21.15.184:6837","nonce":236760278}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":16,"addr":"172.21.15.122:6837/3109792741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3109792741},{"type":"v1","addr":"172.21.15.122:6837","nonce":3109792741}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6839/1323973245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1323973245},{"type":"v1","addr":"172.21.15.184:6839","nonce":1323973245}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6839/1686011933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1686011933},{"type":"v1","addr":"172.21.15.122:6839","nonce":1686011933}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24445,24443,24430,24476,14583]},"id":1}]} 2024-09-19T09:18:00.423 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 60 2024-09-19T09:18:00.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f58ec0a33b0 msgr2=0x7f58ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f58ec0a33b0 0x7f58ec0a5870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005d00 tx=0x7f58f000b510 comp rx=0 tx=0).stop 2024-09-19T09:18:00.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 msgr2=0x7f59001987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 0x7f59001987a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f58e800d950 tx=0x7f58e800de10 comp rx=0 tx=0).stop 2024-09-19T09:18:00.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 shutdown_connections 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5900105500 0x7f590019cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5900100c70 0x7f59001987a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f58ec0a33b0 0x7f58ec0a5870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 --2- 172.21.15.83:0/3164269584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59001002c0 0x7f5900198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 >> 172.21.15.83:0/3164269584 conn(0x7f5900077010 msgr2=0x7f5900103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 shutdown_connections 2024-09-19T09:18:00.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:00.423+0000 7f59049a2640 1 -- 172.21.15.83:0/3164269584 wait complete. 2024-09-19T09:18:00.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:00 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3164269584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:00.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:00 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3164269584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:00.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:00 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3164269584' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:01.070 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:18:01.315 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:01.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:01 smithi083 ceph-mon[30926]: pgmap v472: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:18:01.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 -- 172.21.15.83:0/947836555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 msgr2=0x7f9944100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 --2- 172.21.15.83:0/947836555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f9944100ee0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f992c009930 tx=0x7f992c02a420 comp rx=0 tx=0).stop 2024-09-19T09:18:01.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 -- 172.21.15.83:0/947836555 shutdown_connections 2024-09-19T09:18:01.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 --2- 172.21.15.83:0/947836555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9944101420 0x7f994410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 --2- 172.21.15.83:0/947836555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f9944100ee0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 --2- 172.21.15.83:0/947836555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9944106a80 0x7f9944106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 -- 172.21.15.83:0/947836555 >> 172.21.15.83:0/947836555 conn(0x7f99440fc7a0 msgr2=0x7f99440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 -- 172.21.15.83:0/947836555 shutdown_connections 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.815+0000 7f994a389640 1 -- 172.21.15.83:0/947836555 wait complete. 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 Processor -- start 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 -- start start 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f99441972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9944101420 0x7f9944197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9944106a80 0x7f994419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9944110d30 con 0x7f9944100a80 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9944110bb0 con 0x7f9944106a80 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f994a389640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9944110eb0 con 0x7f9944101420 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f9943fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f99441972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f9943fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f99441972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47744/0 (socket says 172.21.15.83:47744) 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f9943fff640 1 -- 172.21.15.83:0/2614232334 learned_addr learned my addr 172.21.15.83:0/2614232334 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f993bfff640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9944101420 0x7f9944197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.816+0000 7f9948926640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9944106a80 0x7f994419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9943fff640 1 -- 172.21.15.83:0/2614232334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9944101420 msgr2=0x7f9944197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9943fff640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9944101420 0x7f9944197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9943fff640 1 -- 172.21.15.83:0/2614232334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9944106a80 msgr2=0x7f994419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9943fff640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9944106a80 0x7f994419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9943fff640 1 -- 172.21.15.83:0/2614232334 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994419c2a0 con 0x7f9944100a80 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9943fff640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f99441972f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f993400d770 tx=0x7f993400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:01.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934017070 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99340054d0 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994419c590 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934004cf0 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.817+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a3e70 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.818+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9944100ee0 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.819+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9934004e90 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.820+0000 7f9941ffb640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f99300a3430 0x7f99300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.820+0000 7f993bfff640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f99300a3430 0x7f99300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.820+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9394+0+0 (secure 0 0 0) 0x7f99340cf990 con 0x7f9944100a80 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.821+0000 7f993bfff640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f99300a3430 0x7f99300a58f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f992c009900 tx=0x7f992c000bc0 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.825+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f993409b950 con 0x7f9944100a80 2024-09-19T09:18:01.862 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:01 smithi122 ceph-mon[34247]: pgmap v472: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:18:01.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:01 smithi184 ceph-mon[35007]: pgmap v472: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:18:01.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.992+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9944108ff0 con 0x7f9944100a80 2024-09-19T09:18:01.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.993+0000 7f9941ffb640 1 -- 172.21.15.83:0/2614232334 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+25260 (secure 0 0 0) 0x7f993409fc50 con 0x7f9944100a80 2024-09-19T09:18:01.996 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-19T09:18:01.996 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":109,"fsid":"68681c4c-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:52:50.113301+0000","modified":"2024-09-19T09:17:25.488136+0000","last_up_change":"2024-09-19T08:59:44.991971+0000","last_in_change":"2024-09-19T08:59:21.935899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:55:57.133143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:00:33.986862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:00:35.909807+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T09:00:42.339991+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4d0c1021-57d7-471d-830e-751d6c8d2375","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6803","nonce":2608393780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6805","nonce":2608393780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6809","nonce":2608393780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":2608393780},{"type":"v1","addr":"172.21.15.83:6807","nonce":2608393780}]},"public_addr":"172.21.15.83:6803/2608393780","cluster_addr":"172.21.15.83:6805/2608393780","heartbeat_back_addr":"172.21.15.83:6809/2608393780","heartbeat_front_addr":"172.21.15.83:6807/2608393780","state":["exists","up"]},{"osd":1,"uuid":"d3a22d9c-ed3c-4f83-95cd-7801d8da969d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6801","nonce":3677858839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6803","nonce":3677858839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6807","nonce":3677858839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3677858839},{"type":"v1","addr":"172.21.15.122:6805","nonce":3677858839}]},"public_addr":"172.21.15.122:6801/3677858839","cluster_addr":"172.21.15.122:6803/3677858839","heartbeat_back_addr":"172.21.15.122:6807/3677858839","heartbeat_front_addr":"172.21.15.122:6805/3677858839","state":["exists","up"]},{"osd":2,"uuid":"886ac026-4d30-4180-af0e-945bc38124de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6801","nonce":612727003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6803","nonce":612727003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6807","nonce":612727003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":612727003},{"type":"v1","addr":"172.21.15.184:6805","nonce":612727003}]},"public_addr":"172.21.15.184:6801/612727003","cluster_addr":"172.21.15.184:6803/612727003","heartbeat_back_addr":"172.21.15.184:6807/612727003","heartbeat_front_addr":"172.21.15.184:6805/612727003","state":["exists","up"]},{"osd":3,"uuid":"fea364e4-e588-486f-8d83-113e0a7f5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6811","nonce":261647633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6813","nonce":261647633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6817","nonce":261647633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":261647633},{"type":"v1","addr":"172.21.15.83:6815","nonce":261647633}]},"public_addr":"172.21.15.83:6811/261647633","cluster_addr":"172.21.15.83:6813/261647633","heartbeat_back_addr":"172.21.15.83:6817/261647633","heartbeat_front_addr":"172.21.15.83:6815/261647633","state":["exists","up"]},{"osd":4,"uuid":"c716b030-b753-495f-af07-bfe38073eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6809","nonce":2534293104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6811","nonce":2534293104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6815","nonce":2534293104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2534293104},{"type":"v1","addr":"172.21.15.122:6813","nonce":2534293104}]},"public_addr":"172.21.15.122:6809/2534293104","cluster_addr":"172.21.15.122:6811/2534293104","heartbeat_back_addr":"172.21.15.122:6815/2534293104","heartbeat_front_addr":"172.21.15.122:6813/2534293104","state":["exists","up"]},{"osd":5,"uuid":"afd43e53-08bc-4a58-b655-f00db3aa2b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6809","nonce":2450970045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6811","nonce":2450970045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6815","nonce":2450970045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2450970045},{"type":"v1","addr":"172.21.15.184:6813","nonce":2450970045}]},"public_addr":"172.21.15.184:6809/2450970045","cluster_addr":"172.21.15.184:6811/2450970045","heartbeat_back_addr":"172.21.15.184:6815/2450970045","heartbeat_front_addr":"172.21.15.184:6813/2450970045","state":["exists","up"]},{"osd":6,"uuid":"bdbae412-c690-425e-ac5e-96d1481a5463","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6819","nonce":1892974872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6821","nonce":1892974872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6825","nonce":1892974872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":1892974872},{"type":"v1","addr":"172.21.15.83:6823","nonce":1892974872}]},"public_addr":"172.21.15.83:6819/1892974872","cluster_addr":"172.21.15.83:6821/1892974872","heartbeat_back_addr":"172.21.15.83:6825/1892974872","heartbeat_front_addr":"172.21.15.83:6823/1892974872","state":["exists","up"]},{"osd":7,"uuid":"f12c9d22-a585-4926-8058-be2ba2ba2fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6817","nonce":1549732923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6819","nonce":1549732923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6823","nonce":1549732923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1549732923},{"type":"v1","addr":"172.21.15.122:6821","nonce":1549732923}]},"public_addr":"172.21.15.122:6817/1549732923","cluster_addr":"172.21.15.122:6819/1549732923","heartbeat_back_addr":"172.21.15.122:6823/1549732923","heartbeat_front_addr":"172.21.15.122:6821/1549732923","state":["exists","up"]},{"osd":8,"uuid":"3952f1a9-50b1-4036-94a8-22eb5e763ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6817","nonce":1048154265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6819","nonce":1048154265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6823","nonce":1048154265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1048154265},{"type":"v1","addr":"172.21.15.184:6821","nonce":1048154265}]},"public_addr":"172.21.15.184:6817/1048154265","cluster_addr":"172.21.15.184:6819/1048154265","heartbeat_back_addr":"172.21.15.184:6823/1048154265","heartbeat_front_addr":"172.21.15.184:6821/1048154265","state":["exists","up"]},{"osd":9,"uuid":"814dd884-f3d2-451c-afb6-44ea8e34c75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6827","nonce":3960303414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6829","nonce":3960303414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6833","nonce":3960303414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3960303414},{"type":"v1","addr":"172.21.15.83:6831","nonce":3960303414}]},"public_addr":"172.21.15.83:6827/3960303414","cluster_addr":"172.21.15.83:6829/3960303414","heartbeat_back_addr":"172.21.15.83:6833/3960303414","heartbeat_front_addr":"172.21.15.83:6831/3960303414","state":["exists","up"]},{"osd":10,"uuid":"1e5cf625-8523-4410-b239-9f05ff594ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6825","nonce":2508026961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6827","nonce":2508026961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6831","nonce":2508026961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2508026961},{"type":"v1","addr":"172.21.15.122:6829","nonce":2508026961}]},"public_addr":"172.21.15.122:6825/2508026961","cluster_addr":"172.21.15.122:6827/2508026961","heartbeat_back_addr":"172.21.15.122:6831/2508026961","heartbeat_front_addr":"172.21.15.122:6829/2508026961","state":["exists","up"]},{"osd":11,"uuid":"617cb685-6467-46dc-95a8-9e7cace13cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6825","nonce":1459778997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6827","nonce":1459778997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6831","nonce":1459778997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1459778997},{"type":"v1","addr":"172.21.15.184:6829","nonce":1459778997}]},"public_addr":"172.21.15.184:6825/1459778997","cluster_addr":"172.21.15.184:6827/1459778997","heartbeat_back_addr":"172.21.15.184:6831/1459778997","heartbeat_front_addr":"172.21.15.184:6829/1459778997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:04.969008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:28.595125+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:55:53.116175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:19.385908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:44.761808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:09.749425+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:36.072338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:01.389804+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:26.756930+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:51.961741+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:17.397288+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:43.788233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/2542755280":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/931956178":"2024-09-20T09:03:00.037901+0000","172.21.15.83:6801/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/2542755280":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/3669863104":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/3719562585":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4167999844":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6800/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:6801/3693558817":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4197257925":"2024-09-20T08:53:19.429460+0000","172.21.15.83:0/4071352347":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3215219814":"2024-09-20T08:53:42.831703+0000","172.21.15.83:6800/1883694223":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/512658189":"2024-09-20T09:03:00.037901+0000","172.21.15.83:0/1998970001":"2024-09-20T08:53:42.831703+0000","172.21.15.83:0/3109717577":"2024-09-20T09:03:00.037901+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f99300a3430 msgr2=0x7f99300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f99300a3430 0x7f99300a58f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f992c009900 tx=0x7f992c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 msgr2=0x7f99441972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f99441972f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f993400d770 tx=0x7f993400dc30 comp rx=0 tx=0).stop 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 shutdown_connections 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9944106a80 0x7f994419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f99300a3430 0x7f99300a58f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9944101420 0x7f9944197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 --2- 172.21.15.83:0/2614232334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9944100a80 0x7f99441972f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 >> 172.21.15.83:0/2614232334 conn(0x7f99440fc7a0 msgr2=0x7f99440fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:01.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 shutdown_connections 2024-09-19T09:18:01.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:01.996+0000 7f994a389640 1 -- 172.21.15.83:0/2614232334 wait complete. 2024-09-19T09:18:02.686 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:02 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2614232334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:02.715 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:18:02.878 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:02 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2614232334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:02.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:02 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2614232334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:02.966 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:03.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 -- 172.21.15.83:0/2408793421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 msgr2=0x7f053010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 --2- 172.21.15.83:0/2408793421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f053010ea90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0528009ca0 tx=0x7f052802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 -- 172.21.15.83:0/2408793421 shutdown_connections 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 --2- 172.21.15.83:0/2408793421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f053010ea90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 --2- 172.21.15.83:0/2408793421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f05301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 --2- 172.21.15.83:0/2408793421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0530101de0 0x7f05301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 -- 172.21.15.83:0/2408793421 >> 172.21.15.83:0/2408793421 conn(0x7f05300fd8c0 msgr2=0x7f05300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 -- 172.21.15.83:0/2408793421 shutdown_connections 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 -- 172.21.15.83:0/2408793421 wait complete. 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 Processor -- start 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.428+0000 7f05364d9640 1 -- start start 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0530101de0 0x7f05300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f0530074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f0530074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0530111e20 con 0x7f0530106f10 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0530111ca0 con 0x7f0530102790 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0530111fa0 con 0x7f0530101de0 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f0534a76640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f0530074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f0530074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f0530074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.83:33244/0 (socket says 172.21.15.83:33244) 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 -- 172.21.15.83:0/1474771654 learned_addr learned my addr 172.21.15.83:0/1474771654 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f0534a76640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f0530074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47770/0 (socket says 172.21.15.83:47770) 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052ffff640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0530101de0 0x7f05300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 -- 172.21.15.83:0/1474771654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0530101de0 msgr2=0x7f05300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0530101de0 0x7f05300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 -- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 msgr2=0x7f0530074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f0530074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 -- 172.21.15.83:0/1474771654 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05301a6810 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052f7fe640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f0530074a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f052400e9f0 tx=0x7f052400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052400cd80 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.429+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05301a6b00 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.430+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05240108e0 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.430+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0524018920 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.430+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05301a7090 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.430+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05301021c0 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.432+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0524010a90 con 0x7f0530102790 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.432+0000 7f052d7fa640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f05180a33b0 0x7f05180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.432+0000 7f052ffff640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f05180a33b0 0x7f05180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.432+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9394+0+0 (secure 0 0 0) 0x7f05240d04e0 con 0x7f0530102790 2024-09-19T09:18:03.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.433+0000 7f052ffff640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f05180a33b0 0x7f05180a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0520005fd0 tx=0x7f0520005850 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.436+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f052409caf0 con 0x7f0530102790 2024-09-19T09:18:03.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.638+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f053010a1b0 con 0x7f0530102790 2024-09-19T09:18:03.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.649+0000 7f052d7fa640 1 -- 172.21.15.83:0/1474771654 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) ==== 161+0+0 (secure 0 0 0) 0x7f052409c3f0 con 0x7f0530102790 2024-09-19T09:18:03.651 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:18:03.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.651+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f05180a33b0 msgr2=0x7f05180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.651+0000 7f05364d9640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f05180a33b0 0x7f05180a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0520005fd0 tx=0x7f0520005850 comp rx=0 tx=0).stop 2024-09-19T09:18:03.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.651+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 msgr2=0x7f0530074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.651+0000 7f05364d9640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f0530074a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f052400e9f0 tx=0x7f052400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 shutdown_connections 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0530106f10 0x7f0530074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0530102790 0x7f0530074a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f05180a33b0 0x7f05180a5870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 --2- 172.21.15.83:0/1474771654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0530101de0 0x7f05300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 >> 172.21.15.83:0/1474771654 conn(0x7f05300fd8c0 msgr2=0x7f05300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 shutdown_connections 2024-09-19T09:18:03.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:03.652+0000 7f05364d9640 1 -- 172.21.15.83:0/1474771654 wait complete. 2024-09-19T09:18:03.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-mon[35007]: pgmap v473: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-19T09:18:03.900 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l[65322]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l[65322]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-mds[65326]: -- 172.21.15.184:0/3643100715 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5609f89e5c20 con 0x5609f89c2800 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l[65322]: starting mds.l at 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f[65629]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f[65629]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-mds[65633]: -- 172.21.15.184:0/1508505925 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e196fa5c20 con 0x55e196f82800 2024-09-19T09:18:03.901 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f[65629]: starting mds.f at 2024-09-19T09:18:03.902 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c[65926]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.902 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c[65926]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.902 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-mds[65930]: -- 172.21.15.184:0/3150158721 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5626b673b860 con 0x5626b6719000 2024-09-19T09:18:03.902 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c[65926]: starting mds.c at 2024-09-19T09:18:03.902 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i[66226]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.902 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i[66226]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.903 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-mds[66230]: -- 172.21.15.184:0/307784918 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555b6c2d860 con 0x5555b6c0a800 2024-09-19T09:18:03.903 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:18:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i[66226]: starting mds.i at 2024-09-19T09:18:03.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-mon[34247]: pgmap v473: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-19T09:18:03.962 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.962 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.962 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-mds[63561]: -- 172.21.15.122:0/2296132483 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55955520dc20 con 0x5595551eb000 2024-09-19T09:18:03.962 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: starting mds.b at 2024-09-19T09:18:03.962 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e[62934]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.962 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e[62934]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-mds[62938]: -- 172.21.15.122:0/2379730440 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a0cd15860 con 0x561a0ccf2800 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e[62934]: starting mds.e at 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h[63238]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h[63238]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-mds[63242]: -- 172.21.15.122:0/4001360027 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573d6b2dc20 con 0x5573d6b0a800 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h[63238]: starting mds.h at 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k[62615]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.963 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k[62615]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-mds[62619]: -- 172.21.15.122:0/1981287808 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de2ddfd860 con 0x55de2ddda800 2024-09-19T09:18:03.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:18:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k[62615]: starting mds.k at 2024-09-19T09:18:03.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-mon[30926]: pgmap v473: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-19T09:18:03.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a[30922]: 2024-09-19T09:18:03.640+0000 7fd79a92e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:18:03.965 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g[69444]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.965 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g[69444]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.965 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-mds[69452]: -- 172.21.15.83:0/3056211848 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b9c639860 con 0x562b9c617000 2024-09-19T09:18:03.965 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g[69444]: starting mds.g at 2024-09-19T09:18:03.966 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a[69785]: ignoring --setuser ceph since I am not root 2024-09-19T09:18:03.966 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a[69785]: ignoring --setgroup ceph since I am not root 2024-09-19T09:18:03.966 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-mds[69789]: -- 172.21.15.83:0/1032535014 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e1cf51860 con 0x562e1cf2f000 2024-09-19T09:18:03.966 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:18:03 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a[69785]: starting mds.a at 2024-09-19T09:18:04.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:18:04.740 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/1474771654' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:04 smithi083 ceph-mon[30926]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:18:04.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/1474771654' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:18:04.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:18:04.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:18:04.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:18:04.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:18:04.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T09:18:04.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:04 smithi184 ceph-mon[35007]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:18:04.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/1474771654' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:18:04.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:18:04.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:18:04.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:18:04.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:18:04.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T09:18:04.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:04 smithi122 ceph-mon[34247]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:18:05.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 -- 172.21.15.83:0/1039187822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 msgr2=0x7f073810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:05.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 --2- 172.21.15.83:0/1039187822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073810ea90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0730009ca0 tx=0x7f073002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 -- 172.21.15.83:0/1039187822 shutdown_connections 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 --2- 172.21.15.83:0/1039187822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073810ea90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 --2- 172.21.15.83:0/1039187822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738102790 0x7f07381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 --2- 172.21.15.83:0/1039187822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0738101de0 0x7f07381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 -- 172.21.15.83:0/1039187822 >> 172.21.15.83:0/1039187822 conn(0x7f07380fd8c0 msgr2=0x7f07380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 -- 172.21.15.83:0/1039187822 shutdown_connections 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.237+0000 7f073ecd7640 1 -- 172.21.15.83:0/1039187822 wait complete. 2024-09-19T09:18:05.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 Processor -- start 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 -- start start 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0738101de0 0x7f0738198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738102790 0x7f0738198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0738111e40 con 0x7f0738106f10 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0738111cc0 con 0x7f0738101de0 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ecd7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0738111fc0 con 0x7f0738102790 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:05.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47828/0 (socket says 172.21.15.83:47828) 2024-09-19T09:18:05.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 -- 172.21.15.83:0/2617502198 learned_addr learned my addr 172.21.15.83:0/2617502198 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:05.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073ca73640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0738101de0 0x7f0738198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:05.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f0737fff640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738102790 0x7f0738198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:05.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 -- 172.21.15.83:0/2617502198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738102790 msgr2=0x7f0738198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:05.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738102790 0x7f0738198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 -- 172.21.15.83:0/2617502198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0738101de0 msgr2=0x7f0738198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0738101de0 0x7f0738198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.238+0000 7f073d274640 1 -- 172.21.15.83:0/2617502198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073819d3b0 con 0x7f0738106f10 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.239+0000 7f073d274640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073819ccd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0730009dc0 tx=0x7f0730032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.239+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730003cf0 con 0x7f0738106f10 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.239+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07300044f0 con 0x7f0738106f10 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.239+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073819d640 con 0x7f0738106f10 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.239+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730030bf0 con 0x7f0738106f10 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.239+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07381a4f80 con 0x7f0738106f10 2024-09-19T09:18:05.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.240+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07381021c0 con 0x7f0738106f10 2024-09-19T09:18:05.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.241+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0730004040 con 0x7f0738106f10 2024-09-19T09:18:05.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.242+0000 7f0735ffb640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07280a33b0 0x7f07280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:05.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.242+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9780+0+0 (secure 0 0 0) 0x7f07300f1800 con 0x7f0738106f10 2024-09-19T09:18:05.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.242+0000 7f073ca73640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07280a33b0 0x7f07280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:05.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.242+0000 7f073ca73640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07280a33b0 0x7f07280a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f072c005fd0 tx=0x7f072c005850 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:05.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.246+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07300bde00 con 0x7f0738106f10 2024-09-19T09:18:05.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.445+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f073810a150 con 0x7f0738106f10 2024-09-19T09:18:05.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.650+0000 7f0735ffb640 1 -- 172.21.15.83:0/2617502198 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f07300bd700 con 0x7f0738106f10 2024-09-19T09:18:05.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07280a33b0 msgr2=0x7f07280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:05.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07280a33b0 0x7f07280a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f072c005fd0 tx=0x7f072c005850 comp rx=0 tx=0).stop 2024-09-19T09:18:05.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 msgr2=0x7f073819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073819ccd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0730009dc0 tx=0x7f0730032ff0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 shutdown_connections 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0738106f10 0x7f073819ccd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f07280a33b0 0x7f07280a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738102790 0x7f0738198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 --2- 172.21.15.83:0/2617502198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0738101de0 0x7f0738198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 >> 172.21.15.83:0/2617502198 conn(0x7f07380fd8c0 msgr2=0x7f07380fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 shutdown_connections 2024-09-19T09:18:05.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:05.654+0000 7f073ecd7640 1 -- 172.21.15.83:0/2617502198 wait complete. 2024-09-19T09:18:05.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: pgmap v475: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-19T09:18:05.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6832/2059672401,v1:172.21.15.184:6834/2059672401] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6833/1237183928,v1:172.21.15.184:6835/1237183928] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6837/171547052,v1:172.21.15.184:6839/171547052] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.184:6836/600683297,v1:172.21.15.184:6838/600683297] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6832/3381973388,v1:172.21.15.122:6834/3381973388] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6833/554298110,v1:172.21.15.122:6835/554298110] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6836/3311139847,v1:172.21.15.122:6838/3311139847] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.122:6837/1603960233,v1:172.21.15.122:6839/1603960233] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6839/3462695192,v1:172.21.15.83:6841/3462695192] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: mds.? [v2:172.21.15.83:6838/127722329,v1:172.21.15.83:6840/127722329] up:boot 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:18:05.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:18:05.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:05 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2617502198' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:18:05.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: pgmap v475: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-19T09:18:05.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6832/2059672401,v1:172.21.15.184:6834/2059672401] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6833/1237183928,v1:172.21.15.184:6835/1237183928] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6837/171547052,v1:172.21.15.184:6839/171547052] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.184:6836/600683297,v1:172.21.15.184:6838/600683297] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6832/3381973388,v1:172.21.15.122:6834/3381973388] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6833/554298110,v1:172.21.15.122:6835/554298110] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6836/3311139847,v1:172.21.15.122:6838/3311139847] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.122:6837/1603960233,v1:172.21.15.122:6839/1603960233] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6839/3462695192,v1:172.21.15.83:6841/3462695192] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: mds.? [v2:172.21.15.83:6838/127722329,v1:172.21.15.83:6840/127722329] up:boot 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:18:05.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:18:05.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:05 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2617502198' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: pgmap v475: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6832/2059672401,v1:172.21.15.184:6834/2059672401] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6833/1237183928,v1:172.21.15.184:6835/1237183928] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6837/171547052,v1:172.21.15.184:6839/171547052] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.184:6836/600683297,v1:172.21.15.184:6838/600683297] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6832/3381973388,v1:172.21.15.122:6834/3381973388] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6833/554298110,v1:172.21.15.122:6835/554298110] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6836/3311139847,v1:172.21.15.122:6838/3311139847] up:boot 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:18:05.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.122:6837/1603960233,v1:172.21.15.122:6839/1603960233] up:boot 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6839/3462695192,v1:172.21.15.83:6841/3462695192] up:boot 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: mds.? [v2:172.21.15.83:6838/127722329,v1:172.21.15.83:6840/127722329] up:boot 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:18:05.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='mgr.15288 172.21.15.83:0/2049065220' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:18:05.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:05 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2617502198' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:18:06.359 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:18:06.604 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:06 smithi184 ceph-mon[35007]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:18:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:06 smithi184 ceph-mon[35007]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:18:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:06 smithi184 ceph-mon[35007]: Cluster is now healthy 2024-09-19T09:18:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:06 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2617502198' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:18:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:06 smithi184 ceph-mon[35007]: fsmap 12 up:standby 2024-09-19T09:18:06.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:06 smithi122 ceph-mon[34247]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:18:06.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:06 smithi122 ceph-mon[34247]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:18:06.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:06 smithi122 ceph-mon[34247]: Cluster is now healthy 2024-09-19T09:18:06.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:06 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2617502198' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:18:06.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:06 smithi122 ceph-mon[34247]: fsmap 12 up:standby 2024-09-19T09:18:06.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:06 smithi083 ceph-mon[30926]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:18:06.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:06 smithi083 ceph-mon[30926]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:18:06.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:06 smithi083 ceph-mon[30926]: Cluster is now healthy 2024-09-19T09:18:06.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:06 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2617502198' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:18:06.963 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:06 smithi083 ceph-mon[30926]: fsmap 12 up:standby 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 -- 172.21.15.83:0/513098168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30100a80 msgr2=0x7fcd30100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/513098168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30100a80 0x7fcd30100ee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009930 tx=0x7fcd2402a420 comp rx=0 tx=0).stop 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 -- 172.21.15.83:0/513098168 shutdown_connections 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/513098168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd30101420 0x7fcd3010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/513098168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30100a80 0x7fcd30100ee0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/513098168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30106a80 0x7fcd30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 -- 172.21.15.83:0/513098168 >> 172.21.15.83:0/513098168 conn(0x7fcd300fc7a0 msgr2=0x7fcd300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:07.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 -- 172.21.15.83:0/513098168 shutdown_connections 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.083+0000 7fcd36b0f640 1 -- 172.21.15.83:0/513098168 wait complete. 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 Processor -- start 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 -- start start 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd30100a80 0x7fcd30198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 0x7fcd301988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30106a80 0x7fcd3019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30111e50 con 0x7fcd30101420 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30111cd0 con 0x7fcd30100a80 2024-09-19T09:18:07.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd36b0f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30111fd0 con 0x7fcd30106a80 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 0x7fcd301988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 0x7fcd301988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47850/0 (socket says 172.21.15.83:47850) 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd2ffff640 1 -- 172.21.15.83:0/2181176282 learned_addr learned my addr 172.21.15.83:0/2181176282 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd348ab640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd30100a80 0x7fcd30198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.084+0000 7fcd350ac640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30106a80 0x7fcd3019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2ffff640 1 -- 172.21.15.83:0/2181176282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30106a80 msgr2=0x7fcd3019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2ffff640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30106a80 0x7fcd3019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2ffff640 1 -- 172.21.15.83:0/2181176282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd30100a80 msgr2=0x7fcd30198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2ffff640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd30100a80 0x7fcd30198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2ffff640 1 -- 172.21.15.83:0/2181176282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3019d310 con 0x7fcd30101420 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2ffff640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 0x7fcd301988a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcd24004770 tx=0x7fcd240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:07.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2403f070 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3019d5a0 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd2403b460 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24035070 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.085+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd301a4ee0 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.086+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd301021c0 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.087+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcd2403b610 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.088+0000 7fcd2dffb640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fcd180a33b0 0x7fcd180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.089+0000 7fcd348ab640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fcd180a33b0 0x7fcd180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.089+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9780+0+0 (secure 0 0 0) 0x7fcd240f0580 con 0x7fcd30101420 2024-09-19T09:18:07.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.089+0000 7fcd348ab640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fcd180a33b0 0x7fcd180a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd20005fd0 tx=0x7fcd2000b390 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:07.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.093+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd240bc3c0 con 0x7fcd30101420 2024-09-19T09:18:07.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.260+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd30109020 con 0x7fcd30101420 2024-09-19T09:18:07.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.660+0000 7fcd2dffb640 1 -- 172.21.15.83:0/2181176282 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) ==== 181+0+0 (secure 0 0 0) 0x7fcd240c06c0 con 0x7fcd30101420 2024-09-19T09:18:07.661 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:18:07.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.663+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fcd180a33b0 msgr2=0x7fcd180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.663+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fcd180a33b0 0x7fcd180a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd20005fd0 tx=0x7fcd2000b390 comp rx=0 tx=0).stop 2024-09-19T09:18:07.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.663+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 msgr2=0x7fcd301988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.663+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 0x7fcd301988a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcd24004770 tx=0x7fcd240042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 shutdown_connections 2024-09-19T09:18:07.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fcd180a33b0 0x7fcd180a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30106a80 0x7fcd3019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd30101420 0x7fcd301988a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 --2- 172.21.15.83:0/2181176282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd30100a80 0x7fcd30198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 >> 172.21.15.83:0/2181176282 conn(0x7fcd300fc7a0 msgr2=0x7fcd300fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:07.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 shutdown_connections 2024-09-19T09:18:07.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:07.664+0000 7fcd36b0f640 1 -- 172.21.15.83:0/2181176282 wait complete. 2024-09-19T09:18:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:07 smithi122 ceph-mon[34247]: pgmap v476: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-19T09:18:07.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:07 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2181176282' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:07 smithi083 ceph-mon[30926]: pgmap v476: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-19T09:18:07.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:07 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2181176282' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:07 smithi184 ceph-mon[35007]: pgmap v476: 129 pgs: 129 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-09-19T09:18:08.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:07 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2181176282' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:08.475 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:18:08.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:08 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/2181176282' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:08.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:08 smithi083 ceph-mon[30926]: osdmap e111: 12 total, 12 up, 12 in 2024-09-19T09:18:08.724 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:08 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/2181176282' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:08.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:08 smithi122 ceph-mon[34247]: osdmap e111: 12 total, 12 up, 12 in 2024-09-19T09:18:09.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:08 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/2181176282' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:09.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:08 smithi184 ceph-mon[35007]: osdmap e111: 12 total, 12 up, 12 in 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 -- 172.21.15.83:0/2177855136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 msgr2=0x7fa0b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/2177855136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41067e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009900 tx=0x7fa0a802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 -- 172.21.15.83:0/2177855136 shutdown_connections 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/2177855136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4106f10 0x7fa0b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/2177855136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41067e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/2177855136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b4101de0 0x7fa0b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 -- 172.21.15.83:0/2177855136 >> 172.21.15.83:0/2177855136 conn(0x7fa0b40fd8c0 msgr2=0x7fa0b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 -- 172.21.15.83:0/2177855136 shutdown_connections 2024-09-19T09:18:09.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.160+0000 7fa0b8d13640 1 -- 172.21.15.83:0/2177855136 wait complete. 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 Processor -- start 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 -- start start 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4101de0 0x7fa0b4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b4106f10 0x7fa0b419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4111e20 con 0x7fa0b4102790 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4111ca0 con 0x7fa0b4106f10 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b8d13640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4111fa0 con 0x7fa0b4101de0 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47858/0 (socket says 172.21.15.83:47858) 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 -- 172.21.15.83:0/901361958 learned_addr learned my addr 172.21.15.83:0/901361958 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:09.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b2d9d640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b4106f10 0x7fa0b419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b259c640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4101de0 0x7fa0b4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 -- 172.21.15.83:0/901361958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4101de0 msgr2=0x7fa0b4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4101de0 0x7fa0b4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 -- 172.21.15.83:0/901361958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b4106f10 msgr2=0x7fa0b419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b4106f10 0x7fa0b419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 -- 172.21.15.83:0/901361958 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b419d310 con 0x7fa0b4102790 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b259c640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4101de0 0x7fa0b4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.161+0000 7fa0b1d9b640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41988a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8006010 tx=0x7fa0a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.162+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a803f030 con 0x7fa0b4102790 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.162+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0a80035f0 con 0x7fa0b4102790 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.162+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b419d5a0 con 0x7fa0b4102790 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.162+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8035070 con 0x7fa0b4102790 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.162+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b41a4ee0 con 0x7fa0b4102790 2024-09-19T09:18:09.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.163+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b41032c0 con 0x7fa0b4102790 2024-09-19T09:18:09.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.164+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa0a8003b10 con 0x7fa0b4102790 2024-09-19T09:18:09.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.164+0000 7fa0a37fe640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa09c0a33b0 0x7fa09c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.165+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9255+0+0 (secure 0 0 0) 0x7fa0a80f0e40 con 0x7fa0b4102790 2024-09-19T09:18:09.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.165+0000 7fa0b259c640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa09c0a33b0 0x7fa09c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.165+0000 7fa0b259c640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa09c0a33b0 0x7fa09c0a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40058c0 tx=0x7fa0a4005d30 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.168+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0a80bd540 con 0x7fa0b4102790 2024-09-19T09:18:09.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.335+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa0b410a0f0 con 0x7fa0b4102790 2024-09-19T09:18:09.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.666+0000 7fa0a37fe640 1 -- 172.21.15.83:0/901361958 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) ==== 169+0+0 (secure 0 0 0) 0x7fa0a80bce40 con 0x7fa0b4102790 2024-09-19T09:18:09.668 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa09c0a33b0 msgr2=0x7fa09c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa09c0a33b0 0x7fa09c0a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40058c0 tx=0x7fa0a4005d30 comp rx=0 tx=0).stop 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 msgr2=0x7fa0b41988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41988a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8006010 tx=0x7fa0a8004270 comp rx=0 tx=0).stop 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 shutdown_connections 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b4106f10 0x7fa0b419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0b4102790 0x7fa0b41988a0 secure :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8006010 tx=0x7fa0a8004270 comp rx=0 tx=0).stop 2024-09-19T09:18:09.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7fa09c0a33b0 0x7fa09c0a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 --2- 172.21.15.83:0/901361958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b4101de0 0x7fa0b4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 >> 172.21.15.83:0/901361958 conn(0x7fa0b40fd8c0 msgr2=0x7fa0b40fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 shutdown_connections 2024-09-19T09:18:09.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:09.670+0000 7fa0b8d13640 1 -- 172.21.15.83:0/901361958 wait complete. 2024-09-19T09:18:09.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:09 smithi122 ceph-mon[34247]: pgmap v478: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:09.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:09 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/901361958' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:09.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:09 smithi083 ceph-mon[30926]: pgmap v478: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:09.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:09 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/901361958' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:10.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:09 smithi184 ceph-mon[35007]: pgmap v478: 97 pgs: 97 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:10.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:09 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/901361958' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:10.329 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 68681c4c-7664-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T09:18:10.575 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:10.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:10 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/901361958' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:10.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:10 smithi184 ceph-mon[35007]: osdmap e112: 12 total, 12 up, 12 in 2024-09-19T09:18:10.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:10 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/901361958' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:10.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:10 smithi122 ceph-mon[34247]: osdmap e112: 12 total, 12 up, 12 in 2024-09-19T09:18:10.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:10 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/901361958' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:10.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:10 smithi083 ceph-mon[30926]: osdmap e112: 12 total, 12 up, 12 in 2024-09-19T09:18:11.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 -- 172.21.15.83:0/930735336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 msgr2=0x7f953c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 --2- 172.21.15.83:0/930735336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1029b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9528009900 tx=0x7f952802a480 comp rx=0 tx=0).stop 2024-09-19T09:18:11.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 -- 172.21.15.83:0/930735336 shutdown_connections 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 --2- 172.21.15.83:0/930735336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f953c102ef0 0x7f953c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 --2- 172.21.15.83:0/930735336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1029b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 --2- 172.21.15.83:0/930735336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953c100e20 0x7f953c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 -- 172.21.15.83:0/930735336 >> 172.21.15.83:0/930735336 conn(0x7f953c0fc7d0 msgr2=0x7f953c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 -- 172.21.15.83:0/930735336 shutdown_connections 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 -- 172.21.15.83:0/930735336 wait complete. 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 Processor -- start 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.085+0000 7f9542ddd640 1 -- start start 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f953c100e20 0x7f953c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953c102ef0 0x7f953c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f953c110e30 con 0x7f953c102570 2024-09-19T09:18:11.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f953c110cb0 con 0x7f953c102ef0 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f953c110fb0 con 0x7f953c100e20 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32964/0 (socket says 172.21.15.83:32964) 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 -- 172.21.15.83:0/3561721679 learned_addr learned my addr 172.21.15.83:0/3561721679 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9540b79640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f953c100e20 0x7f953c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f954137a640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953c102ef0 0x7f953c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 -- 172.21.15.83:0/3561721679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f953c100e20 msgr2=0x7f953c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f953c100e20 0x7f953c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 -- 172.21.15.83:0/3561721679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953c102ef0 msgr2=0x7f953c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953c102ef0 0x7f953c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 -- 172.21.15.83:0/3561721679 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c19d450 con 0x7f953c102570 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f953bfff640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1989e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9528006010 tx=0x7f95280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952803f030 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9528003cb0 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.086+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953c19d6e0 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.087+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528035070 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.087+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953c1a5020 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.088+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953c101200 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.089+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9528042030 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.089+0000 7f9539ffb640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f952c0a33b0 0x7f952c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.090+0000 7f9540b79640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f952c0a33b0 0x7f952c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.090+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8754+0+0 (secure 0 0 0) 0x7f95280f01c0 con 0x7f953c102570 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.090+0000 7f9540b79640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f952c0a33b0 0x7f952c0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f953000bbe0 tx=0x7f953000b390 comp rx=0 tx=0).ready entity=mgr.15288 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.094+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f95280bc500 con 0x7f953c102570 2024-09-19T09:18:11.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.259+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f953c10a0a0 con 0x7f953c102570 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.687+0000 7f9539ffb640 1 -- 172.21.15.83:0/3561721679 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v113) ==== 178+0+0 (secure 0 0 0) 0x7f95280c0800 con 0x7f953c102570 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data_ec' removed 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.690+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f952c0a33b0 msgr2=0x7f952c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.690+0000 7f9542ddd640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f952c0a33b0 0x7f952c0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f953000bbe0 tx=0x7f953000b390 comp rx=0 tx=0).stop 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.690+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 msgr2=0x7f953c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.690+0000 7f9542ddd640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1989e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9528006010 tx=0x7f95280042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.691+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 shutdown_connections 2024-09-19T09:18:11.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.691+0000 7f9542ddd640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f953c102ef0 0x7f953c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.691+0000 7f9542ddd640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f953c102570 0x7f953c1989e0 secure :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9528006010 tx=0x7f95280042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.691+0000 7f9542ddd640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.83:6800/2671255807,v1:172.21.15.83:6801/2671255807] conn(0x7f952c0a33b0 0x7f952c0a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.691+0000 7f9542ddd640 1 --2- 172.21.15.83:0/3561721679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f953c100e20 0x7f953c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.691+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 >> 172.21.15.83:0/3561721679 conn(0x7f953c0fc7d0 msgr2=0x7f953c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.692+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 shutdown_connections 2024-09-19T09:18:11.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-19T09:18:11.692+0000 7f9542ddd640 1 -- 172.21.15.83:0/3561721679 wait complete. 2024-09-19T09:18:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:11 smithi122 ceph-mon[34247]: pgmap v480: 33 pgs: 33 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:11.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:11 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3561721679' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:11.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:11 smithi083 ceph-mon[30926]: pgmap v480: 33 pgs: 33 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:11.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:11 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3561721679' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:11 smithi184 ceph-mon[35007]: pgmap v480: 33 pgs: 33 active+clean; 15 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:11 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3561721679' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:18:12.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:18:12.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:18:12.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:18:12.606 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:18:12.606 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:18:12.643 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:18:12.667 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:18:12.702 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:18:12.702 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:18:12.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:18:12.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:12 smithi184 ceph-mon[35007]: from='client.? 172.21.15.83:0/3561721679' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:12.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:12 smithi184 ceph-mon[35007]: osdmap e113: 12 total, 12 up, 12 in 2024-09-19T09:18:12.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:12 smithi122 ceph-mon[34247]: from='client.? 172.21.15.83:0/3561721679' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:12.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:12 smithi122 ceph-mon[34247]: osdmap e113: 12 total, 12 up, 12 in 2024-09-19T09:18:12.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:12 smithi083 ceph-mon[30926]: from='client.? 172.21.15.83:0/3561721679' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:18:12.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:12 smithi083 ceph-mon[30926]: osdmap e113: 12 total, 12 up, 12 in 2024-09-19T09:18:12.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:12 smithi083 systemd[1]: Stopping Ceph mon.a for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:13.463 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:13 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a[30922]: 2024-09-19T09:18:13.138+0000 7fd7a0139640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:13.463 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:13 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a[30922]: 2024-09-19T09:18:13.138+0000 7fd7a0139640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:18:13.463 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:13 smithi083 podman[103697]: 2024-09-19 09:18:13.343055248 +0000 UTC m=+0.326114430 container died 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:18:13.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:13 smithi083 podman[103697]: 2024-09-19 09:18:13.756087736 +0000 UTC m=+0.739146920 container cleanup 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:18:13.962 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:13 smithi083 bash[103697]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:18:14.338 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 19 09:18:14 smithi083 podman[103711]: 2024-09-19 09:18:14.049856159 +0000 UTC m=+0.708719667 container remove 4f1d81f95fcb6f1c80d61169868a40dd9eb1878eff472e94b6b69073a27bce70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:18:14.353 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:18:14.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:14.411 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:18:14.411 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:18:14.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:18:14.711 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:14 smithi122 systemd[1]: Stopping Ceph mon.b for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:16.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:16 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-b[34243]: 2024-09-19T09:18:16.638+0000 7f1978578640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:16.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:16 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-b[34243]: 2024-09-19T09:18:16.638+0000 7f1978578640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:18:16.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:16 smithi122 podman[70414]: 2024-09-19 09:18:16.81289379 +0000 UTC m=+1.821327257 container died 91311b3e861fcd7f6cb0b74855b84e51355422434f69f6d1980faf78f9e7980c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-b, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:18:22.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:22 smithi122 podman[70414]: 2024-09-19 09:18:22.200726481 +0000 UTC m=+7.209159940 container cleanup 91311b3e861fcd7f6cb0b74855b84e51355422434f69f6d1980faf78f9e7980c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-19T09:18:22.462 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:22 smithi122 bash[70414]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:18:25.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:18:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:25 smithi122 podman[70425]: 2024-09-19 09:18:25.483604385 +0000 UTC m=+8.664520102 container remove 91311b3e861fcd7f6cb0b74855b84e51355422434f69f6d1980faf78f9e7980c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:18:25.961 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:25 smithi122 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T09:18:25.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:25 smithi122 systemd[1]: Stopped Ceph mon.b for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:18:25.962 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 19 09:18:25 smithi122 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.b.service: Consumed 14.658s CPU time. 2024-09-19T09:18:25.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:25.977 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:18:25.977 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:18:25.977 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:18:26.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:26 smithi184 systemd[1]: Stopping Ceph mon.c for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:27.354 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:26 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-c[35003]: 2024-09-19T09:18:26.933+0000 7f1f83d3b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:27.354 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:26 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-c[35003]: 2024-09-19T09:18:26.933+0000 7f1f83d3b640 -1 mon.c@1(probing) e3 *** Got Signal Terminated *** 2024-09-19T09:18:27.354 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:27 smithi184 podman[72926]: 2024-09-19 09:18:27.097074765 +0000 UTC m=+0.321219535 container died fd8b0b47c331434612e4b34b5f36648bfd45ba4491b124e2f39550671bcca2e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:18:27.653 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:27 smithi184 podman[72926]: 2024-09-19 09:18:27.453435542 +0000 UTC m=+0.677580304 container cleanup fd8b0b47c331434612e4b34b5f36648bfd45ba4491b124e2f39550671bcca2e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T09:18:27.654 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 19 09:18:27 smithi184 bash[72926]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:18:27.922 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:18:27.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:27.972 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:18:27.972 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:18:27.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:18:28.462 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:18:28 smithi083 systemd[1]: Stopping Ceph mgr.x for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:30.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:18:30 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x[31154]: 2024-09-19T09:18:30.278+0000 7f36c984b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:30.712 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:18:30 smithi083 podman[103817]: 2024-09-19 09:18:30.320068539 +0000 UTC m=+2.056958759 container died f631a58ea8659e9d27c776be977e36f6c6387f371550a8d4645ecc96205b26ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:18:35.462 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:18:34 smithi083 podman[103817]: 2024-09-19 09:18:34.983780848 +0000 UTC m=+6.720671053 container cleanup f631a58ea8659e9d27c776be977e36f6c6387f371550a8d4645ecc96205b26ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:18:35.462 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 19 09:18:34 smithi083 bash[103817]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:18:37.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:18:37.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:37.331 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:18:37.331 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:18:37.331 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:18:37.659 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:18:37 smithi122 systemd[1]: Stopping Ceph mgr.y for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:37.961 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:18:37 smithi122 podman[70534]: 2024-09-19 09:18:37.658839848 +0000 UTC m=+0.134640397 container died 4db07b8dda5fb55d4ca9acf295665ba850f823481cce06779c286d56859ab3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:18:38.433 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:18:38 smithi122 podman[70534]: 2024-09-19 09:18:38.113814152 +0000 UTC m=+0.589614676 container cleanup 4db07b8dda5fb55d4ca9acf295665ba850f823481cce06779c286d56859ab3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:18:38.433 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 19 09:18:38 smithi122 bash[70534]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:18:38.569 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:18:38.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:38.607 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:18:38.607 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:18:38.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:18:38.900 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:18:38 smithi184 systemd[1]: Stopping Ceph mgr.z for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:39.201 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:18:38 smithi184 podman[73057]: 2024-09-19 09:18:38.928772852 +0000 UTC m=+0.123770989 container died 51bd2485302439dcdc0a20def6d388612bfee57bf3108b776979b63a93fea22b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:18:39.602 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:18:39 smithi184 podman[73057]: 2024-09-19 09:18:39.300540772 +0000 UTC m=+0.495538900 container cleanup 51bd2485302439dcdc0a20def6d388612bfee57bf3108b776979b63a93fea22b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:18:39.602 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 19 09:18:39 smithi184 bash[73057]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:18:39.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:18:39.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:39.818 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:18:39.819 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:18:39.819 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:18:40.212 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:39 smithi083 systemd[1]: Stopping Ceph osd.0 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:40.712 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:40 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0[42263]: 2024-09-19T09:18:40.405+0000 7f077187a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:40.713 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:40 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0[42263]: 2024-09-19T09:18:40.405+0000 7f077187a640 -1 osd.0 113 *** Got signal Terminated *** 2024-09-19T09:18:40.713 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:40 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0[42263]: 2024-09-19T09:18:40.405+0000 7f077187a640 -1 osd.0 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:18:46.432 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:46 smithi083 podman[103949]: 2024-09-19 09:18:46.099985296 +0000 UTC m=+6.088406802 container died 10ec24c586a065873e811396679a1777a0dd473b7e4f3bee2e3cd46595a531fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:18:46.712 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:46 smithi083 podman[103949]: 2024-09-19 09:18:46.531524421 +0000 UTC m=+6.519945929 container cleanup 10ec24c586a065873e811396679a1777a0dd473b7e4f3bee2e3cd46595a531fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:18:46.712 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:46 smithi083 bash[103949]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:18:47.185 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:46 smithi083 podman[103967]: 2024-09-19 09:18:46.758137968 +0000 UTC m=+0.653365058 container remove 10ec24c586a065873e811396679a1777a0dd473b7e4f3bee2e3cd46595a531fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:18:47.462 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:47 smithi083 podman[104056]: 2024-09-19 09:18:47.087611569 +0000 UTC m=+0.016024160 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:47.462 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:47 smithi083 podman[104056]: 2024-09-19 09:18:47.225761108 +0000 UTC m=+0.154173688 container create 71b4d09381d3e5546f1290a9e5263d9b638177fc4a49a2f32f1c2cf00532519c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:18:47.876 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:47 smithi083 podman[104056]: 2024-09-19 09:18:47.483607605 +0000 UTC m=+0.412020184 container init 71b4d09381d3e5546f1290a9e5263d9b638177fc4a49a2f32f1c2cf00532519c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:47.876 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:47 smithi083 podman[104056]: 2024-09-19 09:18:47.486973778 +0000 UTC m=+0.415386359 container start 71b4d09381d3e5546f1290a9e5263d9b638177fc4a49a2f32f1c2cf00532519c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:18:47.876 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:47 smithi083 podman[104056]: 2024-09-19 09:18:47.603966808 +0000 UTC m=+0.532379403 container attach 71b4d09381d3e5546f1290a9e5263d9b638177fc4a49a2f32f1c2cf00532519c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:48.212 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 19 09:18:47 smithi083 podman[104056]: 2024-09-19 09:18:47.875886428 +0000 UTC m=+0.804299017 container died 71b4d09381d3e5546f1290a9e5263d9b638177fc4a49a2f32f1c2cf00532519c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:18:48.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:18:48.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:48.581 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:18:48.581 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:18:48.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:18:48.961 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:48 smithi122 systemd[1]: Stopping Ceph osd.1 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:49.385 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:48 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1[38686]: 2024-09-19T09:18:48.985+0000 7fa3b1b00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:49.386 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:48 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1[38686]: 2024-09-19T09:18:48.985+0000 7fa3b1b00640 -1 osd.1 113 *** Got signal Terminated *** 2024-09-19T09:18:49.386 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:48 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1[38686]: 2024-09-19T09:18:48.985+0000 7fa3b1b00640 -1 osd.1 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:18:55.097 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:54 smithi122 podman[70667]: 2024-09-19 09:18:54.771061728 +0000 UTC m=+5.994455139 container died 85cf9f39228964801b40f750af025f7059f8a213f8eb6ec97db443fab1ce26db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:18:55.446 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:55 smithi122 podman[70667]: 2024-09-19 09:18:55.194457668 +0000 UTC m=+6.417851120 container cleanup 85cf9f39228964801b40f750af025f7059f8a213f8eb6ec97db443fab1ce26db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:55.446 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:55 smithi122 bash[70667]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:18:55.711 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:55 smithi122 podman[70682]: 2024-09-19 09:18:55.445841101 +0000 UTC m=+0.667608517 container remove 85cf9f39228964801b40f750af025f7059f8a213f8eb6ec97db443fab1ce26db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:56.141 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:55 smithi122 podman[70772]: 2024-09-19 09:18:55.752724575 +0000 UTC m=+0.015929576 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:56.141 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:55 smithi122 podman[70772]: 2024-09-19 09:18:55.888637474 +0000 UTC m=+0.151842499 container create a73206254e36865f92517eb1cc14851bfb6dd738523b6188f88df770712e74bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:18:56.142 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:56 smithi122 podman[70772]: 2024-09-19 09:18:56.141533982 +0000 UTC m=+0.404738963 container init a73206254e36865f92517eb1cc14851bfb6dd738523b6188f88df770712e74bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:18:56.461 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:56 smithi122 podman[70772]: 2024-09-19 09:18:56.145156781 +0000 UTC m=+0.408361763 container start a73206254e36865f92517eb1cc14851bfb6dd738523b6188f88df770712e74bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:18:56.462 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:56 smithi122 podman[70772]: 2024-09-19 09:18:56.241351527 +0000 UTC m=+0.504556519 container attach a73206254e36865f92517eb1cc14851bfb6dd738523b6188f88df770712e74bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:56.853 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 19 09:18:56 smithi122 podman[70772]: 2024-09-19 09:18:56.514907683 +0000 UTC m=+0.778112672 container died a73206254e36865f92517eb1cc14851bfb6dd738523b6188f88df770712e74bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:18:57.192 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:18:57.232 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:18:57.232 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:18:57.232 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:18:57.232 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:18:57.530 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:18:57 smithi184 systemd[1]: Stopping Ceph osd.2 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:18:57.900 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:18:57 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2[39964]: 2024-09-19T09:18:57.529+0000 7f214b89c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:18:57.900 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:18:57 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2[39964]: 2024-09-19T09:18:57.529+0000 7f214b89c640 -1 osd.2 113 *** Got signal Terminated *** 2024-09-19T09:18:57.900 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:18:57 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2[39964]: 2024-09-19T09:18:57.529+0000 7f214b89c640 -1 osd.2 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:03.557 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:03 smithi184 podman[73183]: 2024-09-19 09:19:03.255998207 +0000 UTC m=+5.825829528 container died 555a35c33ae83154008a1512573b4bb5b6d429cf5238c6476aa1d4d70fc4f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:19:03.900 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:03 smithi184 podman[73183]: 2024-09-19 09:19:03.663301419 +0000 UTC m=+6.233132737 container cleanup 555a35c33ae83154008a1512573b4bb5b6d429cf5238c6476aa1d4d70fc4f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:19:03.900 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:03 smithi184 bash[73183]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:19:04.376 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:03 smithi184 podman[73198]: 2024-09-19 09:19:03.952328325 +0000 UTC m=+0.688594588 container remove 555a35c33ae83154008a1512573b4bb5b6d429cf5238c6476aa1d4d70fc4f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:19:04.651 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:04 smithi184 podman[73300]: 2024-09-19 09:19:04.278727818 +0000 UTC m=+0.016115045 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:04.651 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:04 smithi184 podman[73300]: 2024-09-19 09:19:04.399494453 +0000 UTC m=+0.136881682 container create 6c2c2ebce524014a45f7e4f1a1ae584889e77c3f74be4d1066fc12013ef26a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:19:04.651 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:04 smithi184 podman[73300]: 2024-09-19 09:19:04.619215642 +0000 UTC m=+0.356602870 container init 6c2c2ebce524014a45f7e4f1a1ae584889e77c3f74be4d1066fc12013ef26a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:19:04.651 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:04 smithi184 podman[73300]: 2024-09-19 09:19:04.622821195 +0000 UTC m=+0.360208428 container start 6c2c2ebce524014a45f7e4f1a1ae584889e77c3f74be4d1066fc12013ef26a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:05.150 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:04 smithi184 podman[73300]: 2024-09-19 09:19:04.685849651 +0000 UTC m=+0.423236891 container attach 6c2c2ebce524014a45f7e4f1a1ae584889e77c3f74be4d1066fc12013ef26a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:19:05.150 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 19 09:19:04 smithi184 podman[73300]: 2024-09-19 09:19:04.88668653 +0000 UTC m=+0.624073760 container died 6c2c2ebce524014a45f7e4f1a1ae584889e77c3f74be4d1066fc12013ef26a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:05.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:19:05.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:05.602 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:19:05.602 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:19:05.602 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:19:05.929 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:05 smithi083 systemd[1]: Stopping Ceph osd.3 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:06.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:05 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3[49121]: 2024-09-19T09:19:05.928+0000 7f6cf2e14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:06.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:05 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3[49121]: 2024-09-19T09:19:05.928+0000 7f6cf2e14640 -1 osd.3 113 *** Got signal Terminated *** 2024-09-19T09:19:06.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:05 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3[49121]: 2024-09-19T09:19:05.928+0000 7f6cf2e14640 -1 osd.3 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:11.904 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:11 smithi083 podman[104175]: 2024-09-19 09:19:11.584553012 +0000 UTC m=+5.781171179 container died 4974cfbda4eef2a8289c57ed6d7ec2ebace5d8191441ec791e25a1c079d5a505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T09:19:12.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 podman[104175]: 2024-09-19 09:19:12.003336552 +0000 UTC m=+6.199954708 container cleanup 4974cfbda4eef2a8289c57ed6d7ec2ebace5d8191441ec791e25a1c079d5a505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:19:12.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 bash[104175]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:19:12.660 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 podman[104192]: 2024-09-19 09:19:12.250166522 +0000 UTC m=+0.644590608 container remove 4974cfbda4eef2a8289c57ed6d7ec2ebace5d8191441ec791e25a1c079d5a505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:19:12.925 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 podman[104275]: 2024-09-19 09:19:12.562888523 +0000 UTC m=+0.016082794 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:12.925 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 podman[104275]: 2024-09-19 09:19:12.680711299 +0000 UTC m=+0.133905555 container create 9f54982f895af9dcdaf9f7f98c6c05437f8ba009ca3e56e24b0160930c310f0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:19:12.925 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 podman[104275]: 2024-09-19 09:19:12.925101619 +0000 UTC m=+0.378295885 container init 9f54982f895af9dcdaf9f7f98c6c05437f8ba009ca3e56e24b0160930c310f0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:19:13.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:12 smithi083 podman[104275]: 2024-09-19 09:19:12.928425205 +0000 UTC m=+0.381619461 container start 9f54982f895af9dcdaf9f7f98c6c05437f8ba009ca3e56e24b0160930c310f0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:19:13.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:13 smithi083 podman[104275]: 2024-09-19 09:19:13.025263604 +0000 UTC m=+0.478457876 container attach 9f54982f895af9dcdaf9f7f98c6c05437f8ba009ca3e56e24b0160930c310f0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:19:13.212 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 19 09:19:13 smithi083 podman[104275]: 2024-09-19 09:19:13.116220164 +0000 UTC m=+0.569414424 container died 9f54982f895af9dcdaf9f7f98c6c05437f8ba009ca3e56e24b0160930c310f0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T09:19:13.863 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:19:13.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:13.902 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:19:13.902 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:19:13.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:19:14.208 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:13 smithi122 systemd[1]: Stopping Ceph osd.4 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:14.461 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:14 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4[45115]: 2024-09-19T09:19:14.207+0000 7f6801f19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:14.461 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:14 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4[45115]: 2024-09-19T09:19:14.207+0000 7f6801f19640 -1 osd.4 113 *** Got signal Terminated *** 2024-09-19T09:19:14.462 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:14 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4[45115]: 2024-09-19T09:19:14.207+0000 7f6801f19640 -1 osd.4 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:20.421 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:20 smithi122 podman[70889]: 2024-09-19 09:19:20.081685217 +0000 UTC m=+5.986465404 container died cf4aa10f693af35318456153fb1e59ee573643eeb8aacf46b0f3ad1688fd8d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:19:20.711 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:20 smithi122 podman[70889]: 2024-09-19 09:19:20.49884103 +0000 UTC m=+6.403621208 container cleanup cf4aa10f693af35318456153fb1e59ee573643eeb8aacf46b0f3ad1688fd8d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:19:20.711 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:20 smithi122 bash[70889]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:19:21.118 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:20 smithi122 podman[70904]: 2024-09-19 09:19:20.725158472 +0000 UTC m=+0.632616507 container remove cf4aa10f693af35318456153fb1e59ee573643eeb8aacf46b0f3ad1688fd8d49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:19:21.437 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:21 smithi122 podman[70994]: 2024-09-19 09:19:21.020295194 +0000 UTC m=+0.015503734 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:21.437 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:21 smithi122 podman[70994]: 2024-09-19 09:19:21.159416761 +0000 UTC m=+0.154625281 container create a04d369a655e923897bd2eebcd7b977675744005ce6b28a9da7b6a93ce87aadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:21.712 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:21 smithi122 podman[70994]: 2024-09-19 09:19:21.436927319 +0000 UTC m=+0.432135845 container init a04d369a655e923897bd2eebcd7b977675744005ce6b28a9da7b6a93ce87aadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:19:21.712 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:21 smithi122 podman[70994]: 2024-09-19 09:19:21.440163877 +0000 UTC m=+0.435372398 container start a04d369a655e923897bd2eebcd7b977675744005ce6b28a9da7b6a93ce87aadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:19:21.713 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:21 smithi122 podman[70994]: 2024-09-19 09:19:21.536879931 +0000 UTC m=+0.532088458 container attach a04d369a655e923897bd2eebcd7b977675744005ce6b28a9da7b6a93ce87aadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T09:19:21.713 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 19 09:19:21 smithi122 podman[70994]: 2024-09-19 09:19:21.631503784 +0000 UTC m=+0.626712313 container died a04d369a655e923897bd2eebcd7b977675744005ce6b28a9da7b6a93ce87aadd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:19:22.210 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:19:22.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:22.249 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:19:22.249 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:19:22.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:19:22.551 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:22 smithi184 systemd[1]: Stopping Ceph osd.5 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:22.900 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:22 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5[46853]: 2024-09-19T09:19:22.549+0000 7f3dda3cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:22.900 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:22 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5[46853]: 2024-09-19T09:19:22.549+0000 7f3dda3cc640 -1 osd.5 113 *** Got signal Terminated *** 2024-09-19T09:19:22.900 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:22 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5[46853]: 2024-09-19T09:19:22.549+0000 7f3dda3cc640 -1 osd.5 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:28.513 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:28 smithi184 podman[73407]: 2024-09-19 09:19:28.227877759 +0000 UTC m=+5.783875644 container died 53c60fe9fa04604c967474bce1c305cfce33f048bc29410adef6cba31dc6d1c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:28.871 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:28 smithi184 podman[73407]: 2024-09-19 09:19:28.602612784 +0000 UTC m=+6.158610663 container cleanup 53c60fe9fa04604c967474bce1c305cfce33f048bc29410adef6cba31dc6d1c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:19:28.871 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:28 smithi184 bash[73407]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:19:29.150 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:28 smithi184 podman[73422]: 2024-09-19 09:19:28.870599665 +0000 UTC m=+0.644898273 container remove 53c60fe9fa04604c967474bce1c305cfce33f048bc29410adef6cba31dc6d1c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:19:29.458 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:29 smithi184 podman[73512]: 2024-09-19 09:19:29.085360214 +0000 UTC m=+0.015950259 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:29.458 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:29 smithi184 podman[73512]: 2024-09-19 09:19:29.221552817 +0000 UTC m=+0.152142868 container create 5f6e785439241dad5358ab95c94027ad47bfb2c923b77937d9ddb4902e1525b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:19:29.901 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:29 smithi184 podman[73512]: 2024-09-19 09:19:29.457844383 +0000 UTC m=+0.388434439 container init 5f6e785439241dad5358ab95c94027ad47bfb2c923b77937d9ddb4902e1525b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:19:29.901 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:29 smithi184 podman[73512]: 2024-09-19 09:19:29.461517335 +0000 UTC m=+0.392107381 container start 5f6e785439241dad5358ab95c94027ad47bfb2c923b77937d9ddb4902e1525b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:19:29.901 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:29 smithi184 podman[73512]: 2024-09-19 09:19:29.55758671 +0000 UTC m=+0.488176769 container attach 5f6e785439241dad5358ab95c94027ad47bfb2c923b77937d9ddb4902e1525b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:19:29.902 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 19 09:19:29 smithi184 podman[73512]: 2024-09-19 09:19:29.660236573 +0000 UTC m=+0.590826620 container died 5f6e785439241dad5358ab95c94027ad47bfb2c923b77937d9ddb4902e1525b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:19:30.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:19:30.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:30.382 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:19:30.383 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:19:30.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:19:30.699 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:30 smithi083 systemd[1]: Stopping Ceph osd.6 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:30.962 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:30 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6[56053]: 2024-09-19T09:19:30.697+0000 7f85c0453640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:30.962 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:30 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6[56053]: 2024-09-19T09:19:30.697+0000 7f85c0453640 -1 osd.6 113 *** Got signal Terminated *** 2024-09-19T09:19:30.962 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:30 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6[56053]: 2024-09-19T09:19:30.697+0000 7f85c0453640 -1 osd.6 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:36.766 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:36 smithi083 podman[104376]: 2024-09-19 09:19:36.495031024 +0000 UTC m=+5.920881753 container died 41bb141ed17d417855c8e1ef1b939504b09c2d3b79e52ba53880bc282ece78c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:19:37.149 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:36 smithi083 podman[104376]: 2024-09-19 09:19:36.873110947 +0000 UTC m=+6.298961668 container cleanup 41bb141ed17d417855c8e1ef1b939504b09c2d3b79e52ba53880bc282ece78c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:37.150 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:36 smithi083 bash[104376]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:19:37.458 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104393]: 2024-09-19 09:19:37.149416825 +0000 UTC m=+0.653151443 container remove 41bb141ed17d417855c8e1ef1b939504b09c2d3b79e52ba53880bc282ece78c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:19:37.711 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104481]: 2024-09-19 09:19:37.360400429 +0000 UTC m=+0.015774504 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:37.711 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104481]: 2024-09-19 09:19:37.466926078 +0000 UTC m=+0.122300151 container create 40d3773aafc48befa6badc0560fef3c7ca54d78d373adbb22da3c9e1454fc4c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:19:37.711 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104481]: 2024-09-19 09:19:37.711125784 +0000 UTC m=+0.366499864 container init 40d3773aafc48befa6badc0560fef3c7ca54d78d373adbb22da3c9e1454fc4c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:19:37.962 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104481]: 2024-09-19 09:19:37.714459538 +0000 UTC m=+0.369833614 container start 40d3773aafc48befa6badc0560fef3c7ca54d78d373adbb22da3c9e1454fc4c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:19:37.963 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104481]: 2024-09-19 09:19:37.794529021 +0000 UTC m=+0.449903103 container attach 40d3773aafc48befa6badc0560fef3c7ca54d78d373adbb22da3c9e1454fc4c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:19:37.963 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 19 09:19:37 smithi083 podman[104481]: 2024-09-19 09:19:37.912450731 +0000 UTC m=+0.567824805 container died 40d3773aafc48befa6badc0560fef3c7ca54d78d373adbb22da3c9e1454fc4c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:19:38.538 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:19:38.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:38.576 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:19:38.577 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:19:38.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:19:38.919 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:38 smithi122 systemd[1]: Stopping Ceph osd.7 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:39.180 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:38 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7[51544]: 2024-09-19T09:19:38.916+0000 7fdfc9883640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:39.181 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:38 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7[51544]: 2024-09-19T09:19:38.916+0000 7fdfc9883640 -1 osd.7 113 *** Got signal Terminated *** 2024-09-19T09:19:39.181 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:38 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7[51544]: 2024-09-19T09:19:38.916+0000 7fdfc9883640 -1 osd.7 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:45.052 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:44 smithi122 podman[71097]: 2024-09-19 09:19:44.745096115 +0000 UTC m=+5.963448882 container died fa755049652366cf82cef7df35d60f317527402f25776bd7843151665cd233fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:19:45.394 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:45 smithi122 podman[71097]: 2024-09-19 09:19:45.14276388 +0000 UTC m=+6.361116652 container cleanup fa755049652366cf82cef7df35d60f317527402f25776bd7843151665cd233fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:45.394 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:45 smithi122 bash[71097]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:19:45.711 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:45 smithi122 podman[71123]: 2024-09-19 09:19:45.394333718 +0000 UTC m=+0.649163515 container remove fa755049652366cf82cef7df35d60f317527402f25776bd7843151665cd233fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:19:46.015 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:45 smithi122 podman[71209]: 2024-09-19 09:19:45.654059443 +0000 UTC m=+0.015594699 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:46.015 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:45 smithi122 podman[71209]: 2024-09-19 09:19:45.753758735 +0000 UTC m=+0.115294027 container create 107f2e7d8db6492e132eb5b8e7dc08ea435e06ba902f09409d96260e8f377021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:19:46.015 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:46 smithi122 podman[71209]: 2024-09-19 09:19:46.014794883 +0000 UTC m=+0.376330129 container init 107f2e7d8db6492e132eb5b8e7dc08ea435e06ba902f09409d96260e8f377021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:19:46.461 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:46 smithi122 podman[71209]: 2024-09-19 09:19:46.018107809 +0000 UTC m=+0.379643055 container start 107f2e7d8db6492e132eb5b8e7dc08ea435e06ba902f09409d96260e8f377021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:19:46.462 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:46 smithi122 podman[71209]: 2024-09-19 09:19:46.098078005 +0000 UTC m=+0.459613269 container attach 107f2e7d8db6492e132eb5b8e7dc08ea435e06ba902f09409d96260e8f377021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:19:46.462 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 19 09:19:46 smithi122 podman[71209]: 2024-09-19 09:19:46.205610684 +0000 UTC m=+0.567145939 container died 107f2e7d8db6492e132eb5b8e7dc08ea435e06ba902f09409d96260e8f377021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:19:46.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:19:46.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:46.831 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:19:46.832 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:19:46.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:19:47.139 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:46 smithi184 systemd[1]: Stopping Ceph osd.8 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:47.400 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:47 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8[53735]: 2024-09-19T09:19:47.137+0000 7f8700570640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:47.400 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:47 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8[53735]: 2024-09-19T09:19:47.137+0000 7f8700570640 -1 osd.8 113 *** Got signal Terminated *** 2024-09-19T09:19:47.400 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:47 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8[53735]: 2024-09-19T09:19:47.137+0000 7f8700570640 -1 osd.8 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:47.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:47 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:47.202+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:47.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:47 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:47.162+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:48.113 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:47 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:47.758+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:48.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:48 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:48.209+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:48.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:48 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:48.168+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:49.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:48 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:48.754+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:49.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:49 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:49.161+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:49.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:49 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:49.169+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:50.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:49 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:49.785+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:50.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:50 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:50.174+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:50.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:50 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:50.140+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:51.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:50 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:50.772+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:51.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:51 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:51.131+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:51.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:51 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:51.094+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:52.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:51 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:51.809+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:52.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:52 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:52.096+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:52.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:52 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:52.060+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:53.150 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:52 smithi184 podman[73615]: 2024-09-19 09:19:52.854381521 +0000 UTC m=+5.827600967 container died feaa12b4dc346a6dad19a7a39eee9cf2adf3274de35e8aeb27ae896c270115ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:19:53.151 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:52 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:52.806+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:53.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:53 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:53.116+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:53.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:53 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:53.049+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:53.548 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:53 smithi184 podman[73615]: 2024-09-19 09:19:53.329478798 +0000 UTC m=+6.302698251 container cleanup feaa12b4dc346a6dad19a7a39eee9cf2adf3274de35e8aeb27ae896c270115ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:19:53.548 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:53 smithi184 bash[73615]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:19:53.810 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:53 smithi184 podman[73640]: 2024-09-19 09:19:53.547206689 +0000 UTC m=+0.670923920 container remove feaa12b4dc346a6dad19a7a39eee9cf2adf3274de35e8aeb27ae896c270115ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:19:54.088 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:53 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:53.808+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:54.088 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:53 smithi184 podman[73732]: 2024-09-19 09:19:53.857995079 +0000 UTC m=+0.016118330 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:54.089 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:53 smithi184 podman[73732]: 2024-09-19 09:19:53.990106704 +0000 UTC m=+0.148229985 container create 89411f4c111398c79ed516a5df23b288b577a8b31a00b48b0e8829f40471ab95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:19:54.401 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:54 smithi184 podman[73732]: 2024-09-19 09:19:54.217555944 +0000 UTC m=+0.375679183 container init 89411f4c111398c79ed516a5df23b288b577a8b31a00b48b0e8829f40471ab95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:19:54.401 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:54 smithi184 podman[73732]: 2024-09-19 09:19:54.220937429 +0000 UTC m=+0.379060668 container start 89411f4c111398c79ed516a5df23b288b577a8b31a00b48b0e8829f40471ab95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:19:54.401 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:54 smithi184 podman[73732]: 2024-09-19 09:19:54.325785383 +0000 UTC m=+0.483908641 container attach 89411f4c111398c79ed516a5df23b288b577a8b31a00b48b0e8829f40471ab95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:54.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:54 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:54.123+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:54.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:54 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:54.083+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:54.695 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 19 09:19:54 smithi184 podman[73732]: 2024-09-19 09:19:54.407266818 +0000 UTC m=+0.565390062 container died 89411f4c111398c79ed516a5df23b288b577a8b31a00b48b0e8829f40471ab95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:19:55.004 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:54 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:54.841+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:55.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:19:55.075 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:19:55.075 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:19:55.076 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:19:55.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:19:55.392 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:55.057+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:55.393 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:55 smithi083 systemd[1]: Stopping Ceph osd.9 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:19:55.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:55 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:55.123+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:55.712 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:55.391+0000 7ff157e1f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:19:55.712 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:55.391+0000 7ff157e1f640 -1 osd.9 113 *** Got signal Terminated *** 2024-09-19T09:19:55.712 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:55 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:55.391+0000 7ff157e1f640 -1 osd.9 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:19:56.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:55 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:55.853+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:56.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:56 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:56.154+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:56.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:56 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:56.154+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:19:56.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:56 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:56.009+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:56.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:56 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:56.009+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:53.326984+0000 front 2024-09-19T09:18:53.327093+0000 (oldest deadline 2024-09-19T09:19:55.626910+0000) 2024-09-19T09:19:57.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:56 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:56.812+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:57.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:57 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:57.149+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:57.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:57 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:57.149+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:19:57.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:57.011+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:57.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:57 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:57.011+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:53.326984+0000 front 2024-09-19T09:18:53.327093+0000 (oldest deadline 2024-09-19T09:19:55.626910+0000) 2024-09-19T09:19:58.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:57 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:57.783+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:58.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:58.140+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:58.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:58 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:58.140+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:19:58.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:58.006+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:58.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:58 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:58.006+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:53.326984+0000 front 2024-09-19T09:18:53.327093+0000 (oldest deadline 2024-09-19T09:19:55.626910+0000) 2024-09-19T09:19:59.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:58 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:58.754+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:19:59.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:59 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:59.110+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:19:59.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:19:59 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:19:59.110+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:19:59.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:59.049+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:19:59.462 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:19:59 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:19:59.049+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:53.326984+0000 front 2024-09-19T09:18:53.327093+0000 (oldest deadline 2024-09-19T09:19:55.626910+0000) 2024-09-19T09:20:00.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:19:59 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:19:59.778+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:00.365 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:20:00.070+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.025399+0000 front 2024-09-19T09:18:44.025458+0000 (oldest deadline 2024-09-19T09:19:46.925536+0000) 2024-09-19T09:20:00.465 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:00 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9[62991]: 2024-09-19T09:20:00.070+0000 7ff154435640 -1 osd.9 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:53.326984+0000 front 2024-09-19T09:18:53.327093+0000 (oldest deadline 2024-09-19T09:19:55.626910+0000) 2024-09-19T09:20:00.466 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:00 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:00.098+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:00.466 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:00 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:00.098+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:01.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:00 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:00.767+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:01.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:01 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:01.136+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:01.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:01 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:01.136+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:01.593 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:01 smithi083 podman[104583]: 2024-09-19 09:20:01.300876758 +0000 UTC m=+6.028028474 container died f9a1b1308a71f3725aac245b114f900da0708e6059bb7d0df496ce7a0607cd94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:01.857 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:01 smithi083 podman[104583]: 2024-09-19 09:20:01.691746497 +0000 UTC m=+6.418898191 container cleanup f9a1b1308a71f3725aac245b114f900da0708e6059bb7d0df496ce7a0607cd94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:20:01.858 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:01 smithi083 bash[104583]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:20:02.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:01 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:01.816+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:02.212 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:01 smithi083 podman[104601]: 2024-09-19 09:20:01.976942959 +0000 UTC m=+0.671305466 container remove f9a1b1308a71f3725aac245b114f900da0708e6059bb7d0df496ce7a0607cd94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:20:02.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:02 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:02.158+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:02.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:02 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:02.158+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:02.630 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:02 smithi083 podman[104698]: 2024-09-19 09:20:02.228211978 +0000 UTC m=+0.019874077 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:02.630 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:02 smithi083 podman[104698]: 2024-09-19 09:20:02.327627893 +0000 UTC m=+0.119289982 container create a603d2f6e15ed036b3aa1ba19e3bd33dac7cb1cc3c18dabab8507f65b4229192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:02.630 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:02 smithi083 podman[104698]: 2024-09-19 09:20:02.544443086 +0000 UTC m=+0.336105185 container init a603d2f6e15ed036b3aa1ba19e3bd33dac7cb1cc3c18dabab8507f65b4229192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:20:02.631 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:02 smithi083 podman[104698]: 2024-09-19 09:20:02.547705103 +0000 UTC m=+0.339367200 container start a603d2f6e15ed036b3aa1ba19e3bd33dac7cb1cc3c18dabab8507f65b4229192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:20:02.631 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:02 smithi083 podman[104698]: 2024-09-19 09:20:02.629991849 +0000 UTC m=+0.421653954 container attach a603d2f6e15ed036b3aa1ba19e3bd33dac7cb1cc3c18dabab8507f65b4229192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:20:02.962 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 19 09:20:02 smithi083 podman[104698]: 2024-09-19 09:20:02.736891544 +0000 UTC m=+0.528553640 container died a603d2f6e15ed036b3aa1ba19e3bd33dac7cb1cc3c18dabab8507f65b4229192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:20:03.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:02 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:02.802+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:03.347 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:20:03.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:03.385 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:20:03.385 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:20:03.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:20:03.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:03.192+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:03.462 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:03.192+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:03.462 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:03 smithi122 systemd[1]: Stopping Ceph osd.10 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:03.961 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:03.712+0000 7fa41b96e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:03.961 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:03.712+0000 7fa41b96e640 -1 osd.10 113 *** Got signal Terminated *** 2024-09-19T09:20:03.961 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:03 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:03.712+0000 7fa41b96e640 -1 osd.10 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:04.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:03 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:03.795+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:04.711 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:04 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:04.238+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:04.711 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:04 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:04.238+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:05.087 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:04 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:04.785+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:05.712 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:05 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:05.220+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:05.712 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:05 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:05.220+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:05.712 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:05 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:05.220+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.682912+0000 front 2024-09-19T09:18:59.682988+0000 (oldest deadline 2024-09-19T09:20:04.382958+0000) 2024-09-19T09:20:06.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:05 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:05.769+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:06.151 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:05 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:05.769+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:06.711 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:06 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:06.232+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:06.711 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:06 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:06.232+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:06.711 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:06 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:06.232+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.682912+0000 front 2024-09-19T09:18:59.682988+0000 (oldest deadline 2024-09-19T09:20:04.382958+0000) 2024-09-19T09:20:07.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:06 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:06.748+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:07.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:06 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:06.748+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:07.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:07 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:07.200+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:07.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:07 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:07.200+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:07.461 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:07 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:07.200+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.682912+0000 front 2024-09-19T09:18:59.682988+0000 (oldest deadline 2024-09-19T09:20:04.382958+0000) 2024-09-19T09:20:08.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:07 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:07.719+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:08.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:07 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:07.719+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:08.631 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:08 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:08.224+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:41.779270+0000 front 2024-09-19T09:18:41.779220+0000 (oldest deadline 2024-09-19T09:19:46.479196+0000) 2024-09-19T09:20:08.632 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:08 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:08.224+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-19T09:18:52.181252+0000 front 2024-09-19T09:18:52.181333+0000 (oldest deadline 2024-09-19T09:19:55.681383+0000) 2024-09-19T09:20:08.632 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:08 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10[58061]: 2024-09-19T09:20:08.224+0000 7fa417f84640 -1 osd.10 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.682912+0000 front 2024-09-19T09:18:59.682988+0000 (oldest deadline 2024-09-19T09:20:04.382958+0000) 2024-09-19T09:20:09.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:08 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:08.713+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:09.151 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:08 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:08.713+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:09.530 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:09 smithi122 podman[71314]: 2024-09-19 09:20:09.275294616 +0000 UTC m=+5.689848359 container died 1583a8c6283c50e2326ef7022652415ae2ba7d3c800c7f380c20d494be41705b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:20:09.962 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:09 smithi122 podman[71314]: 2024-09-19 09:20:09.595293224 +0000 UTC m=+6.009846978 container cleanup 1583a8c6283c50e2326ef7022652415ae2ba7d3c800c7f380c20d494be41705b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:20:09.962 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:09 smithi122 bash[71314]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:20:09.962 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:09 smithi122 podman[71342]: 2024-09-19 09:20:09.763140496 +0000 UTC m=+0.482751812 container remove 1583a8c6283c50e2326ef7022652415ae2ba7d3c800c7f380c20d494be41705b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:20:10.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:09 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:09.719+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:10.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:09 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:09.719+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:10.462 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:10 smithi122 podman[71435]: 2024-09-19 09:20:10.097756863 +0000 UTC m=+0.016164710 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:10.463 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:10 smithi122 podman[71435]: 2024-09-19 09:20:10.213834098 +0000 UTC m=+0.132241971 container create 5d6b99703957b2b95e792c9a608dca6fa7ae454620d27775fd25611c8017a8cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:20:10.463 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:10 smithi122 podman[71435]: 2024-09-19 09:20:10.416622023 +0000 UTC m=+0.335029865 container init 5d6b99703957b2b95e792c9a608dca6fa7ae454620d27775fd25611c8017a8cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:20:10.463 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:10 smithi122 podman[71435]: 2024-09-19 09:20:10.420227945 +0000 UTC m=+0.338635776 container start 5d6b99703957b2b95e792c9a608dca6fa7ae454620d27775fd25611c8017a8cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:20:10.953 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:10 smithi122 podman[71435]: 2024-09-19 09:20:10.499450216 +0000 UTC m=+0.417858056 container attach 5d6b99703957b2b95e792c9a608dca6fa7ae454620d27775fd25611c8017a8cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:20:10.953 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:10 smithi122 podman[71435]: 2024-09-19 09:20:10.609071191 +0000 UTC m=+0.527479025 container died 5d6b99703957b2b95e792c9a608dca6fa7ae454620d27775fd25611c8017a8cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:20:11.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:10 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:10.683+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:11.150 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:10 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:10.683+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:11.205 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 19 09:20:11 smithi122 podman[71458]: 2024-09-19 09:20:11.202764214 +0000 UTC m=+0.587641970 container remove 5d6b99703957b2b95e792c9a608dca6fa7ae454620d27775fd25611c8017a8cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:20:11.231 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:20:11.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:11.270 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:20:11.270 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:20:11.271 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:20:11.599 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:11 smithi184 systemd[1]: Stopping Ceph osd.11 for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:11.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:11 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:11.598+0000 7fe456223640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:11.901 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:11 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:11.598+0000 7fe456223640 -1 osd.11 113 *** Got signal Terminated *** 2024-09-19T09:20:11.901 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:11 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:11.598+0000 7fe456223640 -1 osd.11 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:11.901 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:11 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:11.670+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:11.901 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:11 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:11.670+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:12.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:12 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:12.621+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:12.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:12 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:12.621+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:13.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:13 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:13.611+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:13.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:13 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:13.611+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:13.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:13 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:13.611+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-19T09:19:07.647694+0000 front 2024-09-19T09:19:07.647725+0000 (oldest deadline 2024-09-19T09:20:12.947827+0000) 2024-09-19T09:20:14.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:14 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:14.570+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:14.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:14 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:14.570+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:14.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:14 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:14.570+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-19T09:19:07.647694+0000 front 2024-09-19T09:19:07.647725+0000 (oldest deadline 2024-09-19T09:20:12.947827+0000) 2024-09-19T09:20:15.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:15 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:15.619+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-19T09:18:44.742061+0000 front 2024-09-19T09:18:44.741986+0000 (oldest deadline 2024-09-19T09:19:47.042178+0000) 2024-09-19T09:20:15.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:15 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:15.619+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-19T09:18:59.145157+0000 front 2024-09-19T09:18:59.145173+0000 (oldest deadline 2024-09-19T09:20:05.446151+0000) 2024-09-19T09:20:15.901 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:15 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-19T09:20:15.619+0000 7fe452839640 -1 osd.11 113 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-19T09:19:07.647694+0000 front 2024-09-19T09:19:07.647725+0000 (oldest deadline 2024-09-19T09:20:12.947827+0000) 2024-09-19T09:20:17.537 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:17 smithi184 podman[73838]: 2024-09-19 09:20:17.276596657 +0000 UTC m=+5.809532515 container died 924f039022c06448dca8d7ca7fcda6c10cbe85b3ba1da9c3128c02ab6997a273 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:20:17.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:17 smithi184 podman[73838]: 2024-09-19 09:20:17.65591499 +0000 UTC m=+6.188850835 container cleanup 924f039022c06448dca8d7ca7fcda6c10cbe85b3ba1da9c3128c02ab6997a273 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:17.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:17 smithi184 bash[73838]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:20:18.274 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:17 smithi184 podman[73853]: 2024-09-19 09:20:17.923716532 +0000 UTC m=+0.650422544 container remove 924f039022c06448dca8d7ca7fcda6c10cbe85b3ba1da9c3128c02ab6997a273 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:20:18.552 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:18 smithi184 podman[73943]: 2024-09-19 09:20:18.274578926 +0000 UTC m=+0.110419121 container create 4383c30dd771d792be9ad517a5b141828b2405ff83d61a3fc25ebec98c170a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:20:18.552 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:18 smithi184 podman[73943]: 2024-09-19 09:20:18.179607 +0000 UTC m=+0.015447203 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:18.552 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:18 smithi184 podman[73943]: 2024-09-19 09:20:18.468455705 +0000 UTC m=+0.304295911 container init 4383c30dd771d792be9ad517a5b141828b2405ff83d61a3fc25ebec98c170a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:20:18.552 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:18 smithi184 podman[73943]: 2024-09-19 09:20:18.471819553 +0000 UTC m=+0.307659755 container start 4383c30dd771d792be9ad517a5b141828b2405ff83d61a3fc25ebec98c170a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:18.552 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:18 smithi184 podman[73943]: 2024-09-19 09:20:18.551726165 +0000 UTC m=+0.387566377 container attach 4383c30dd771d792be9ad517a5b141828b2405ff83d61a3fc25ebec98c170a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:18.900 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 19 09:20:18 smithi184 podman[73943]: 2024-09-19 09:20:18.65845363 +0000 UTC m=+0.494293835 container died 4383c30dd771d792be9ad517a5b141828b2405ff83d61a3fc25ebec98c170a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:20:19.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:20:19.268 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:19.268 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:20:19.269 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:20:19.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:20:19.561 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:20:19 smithi083 systemd[1]: Stopping Ceph mds.a for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:19.962 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:20:19 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a[69785]: 2024-09-19T09:20:19.560+0000 7fb9bda4c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:19.962 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:20:19 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a[69785]: 2024-09-19T09:20:19.560+0000 7fb9bda4c640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:20:23.885 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:20:23 smithi083 podman[104800]: 2024-09-19 09:20:23.575112381 +0000 UTC m=+4.117532370 container died 0f6e657e40e61c9948d1d5766ceff36233b167d21213b07ccd4b598a8cff6e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:23.885 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:20:23 smithi083 podman[104800]: 2024-09-19 09:20:23.884946187 +0000 UTC m=+4.427366175 container cleanup 0f6e657e40e61c9948d1d5766ceff36233b167d21213b07ccd4b598a8cff6e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T09:20:24.144 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 19 09:20:23 smithi083 bash[104800]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:20:24.266 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:20:24.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:24.301 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:20:24.301 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:20:24.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:20:24.462 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:20:24 smithi083 systemd[1]: Stopping Ceph mds.d for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:24.962 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:20:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d[68564]: 2024-09-19T09:20:24.630+0000 7f217c793640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:24.962 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:20:24 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d[68564]: 2024-09-19T09:20:24.630+0000 7f217c793640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:20:28.962 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:20:28 smithi083 podman[104920]: 2024-09-19 09:20:28.642668117 +0000 UTC m=+4.123860606 container died 590bfce4f875e9efb0ef4e97b1253a4ad27aee092c4a3c90f8a4a1088af2cad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:20:29.390 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:20:29 smithi083 podman[104920]: 2024-09-19 09:20:29.147159096 +0000 UTC m=+4.628351578 container cleanup 590bfce4f875e9efb0ef4e97b1253a4ad27aee092c4a3c90f8a4a1088af2cad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:20:29.391 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 19 09:20:29 smithi083 bash[104920]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:20:29.531 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:20:29.563 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:29.563 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:20:29.563 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:20:29.564 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:20:29.962 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:29 smithi083 systemd[1]: Stopping Ceph mds.g for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:29.962 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:29 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g[69444]: 2024-09-19T09:20:29.884+0000 7fcbdff23640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:29.962 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:29 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g[69444]: 2024-09-19T09:20:29.884+0000 7fcbdff23640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:20:32.126 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:31 smithi083 podman[105040]: 2024-09-19 09:20:31.799574168 +0000 UTC m=+2.020880673 container died 6887e1914748cb817b7f64e258617eb314720bd58acd9ccf785eeedff52d7ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:20:32.126 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:32 smithi083 podman[105040]: 2024-09-19 09:20:32.126179331 +0000 UTC m=+2.347485835 container cleanup 6887e1914748cb817b7f64e258617eb314720bd58acd9ccf785eeedff52d7ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:20:32.462 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:32 smithi083 bash[105040]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:20:32.462 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 19 09:20:32 smithi083 podman[105052]: 2024-09-19 09:20:32.360902336 +0000 UTC m=+0.559303368 container remove 6887e1914748cb817b7f64e258617eb314720bd58acd9ccf785eeedff52d7ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:20:32.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:20:32.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:32.536 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:20:32.536 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:20:32.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:20:32.856 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:32 smithi083 systemd[1]: Stopping Ceph mds.j for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:33.212 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:32 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j[68146]: 2024-09-19T09:20:32.855+0000 7f6090a91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:33.212 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:32 smithi083 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j[68146]: 2024-09-19T09:20:32.855+0000 7f6090a91640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:20:37.201 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:36 smithi083 podman[105162]: 2024-09-19 09:20:36.879658509 +0000 UTC m=+4.131306824 container died 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:20:37.201 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:37 smithi083 podman[105162]: 2024-09-19 09:20:37.197264887 +0000 UTC m=+4.448913210 container cleanup 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T09:20:37.462 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:37 smithi083 bash[105162]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:20:37.462 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 19 09:20:37 smithi083 podman[105188]: 2024-09-19 09:20:37.398331063 +0000 UTC m=+0.516856858 container remove 972c34db5ab5b9d7bbe4c801e6ce343167d7aea10bf4af497e1a61309a14e60d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:20:37.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:20:37.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:37.645 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:20:37.645 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:20:37.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:20:37.938 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:37 smithi122 systemd[1]: Stopping Ceph mds.b for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:38.211 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:37 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: 2024-09-19T09:20:37.937+0000 7ff64583b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:38.211 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:37 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b[63557]: 2024-09-19T09:20:37.937+0000 7ff64583b640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:20:40.039 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:39 smithi122 podman[71538]: 2024-09-19 09:20:39.74893892 +0000 UTC m=+1.914467430 container died 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:40.364 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:40 smithi122 podman[71538]: 2024-09-19 09:20:40.153865393 +0000 UTC m=+2.319393900 container cleanup 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:20:40.364 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:40 smithi122 bash[71538]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:20:40.592 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:20:40.614 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:40 smithi122 podman[71562]: 2024-09-19 09:20:40.363504301 +0000 UTC m=+0.617301229 container remove 5d57d7561423e477e44d8a847733774dd671a80d39fef50652c381b63d2f8a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:40.614 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:40 smithi122 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-19T09:20:40.614 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:40 smithi122 systemd[1]: Stopped Ceph mds.b for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:20:40.614 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 19 09:20:40 smithi122 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.b.service: Consumed 14.237s CPU time. 2024-09-19T09:20:40.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:40.628 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:20:40.628 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:20:40.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:20:40.958 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:40 smithi122 systemd[1]: Stopping Ceph mds.e for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:41.211 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:40 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e[62934]: 2024-09-19T09:20:40.958+0000 7fe685dbd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:41.211 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:40 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e[62934]: 2024-09-19T09:20:40.958+0000 7fe685dbd640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:20:44.017 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:43 smithi122 podman[71674]: 2024-09-19 09:20:43.755100241 +0000 UTC m=+2.903542741 container died 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:20:44.283 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:44 smithi122 podman[71674]: 2024-09-19 09:20:44.090854545 +0000 UTC m=+3.239297034 container cleanup 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:20:44.284 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:44 smithi122 bash[71674]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:20:44.528 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:20:44.549 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:44 smithi122 podman[71686]: 2024-09-19 09:20:44.283505441 +0000 UTC m=+0.524792129 container remove 4fecdcf786e312a6aa311a72b1f72956fec5cabde6baa14e1f15a42215d89c77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:20:44.549 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:44 smithi122 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-19T09:20:44.549 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:44 smithi122 systemd[1]: Stopped Ceph mds.e for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:20:44.549 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 19 09:20:44 smithi122 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.e.service: Consumed 2.863s CPU time. 2024-09-19T09:20:44.562 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:44.562 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:20:44.562 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:20:44.562 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:20:44.870 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:20:44 smithi122 systemd[1]: Stopping Ceph mds.h for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:45.211 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:20:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h[63238]: 2024-09-19T09:20:44.869+0000 7f2eea68b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:45.211 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:20:44 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h[63238]: 2024-09-19T09:20:44.869+0000 7f2eea68b640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:20:48.048 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:20:47 smithi122 podman[71794]: 2024-09-19 09:20:47.757661005 +0000 UTC m=+2.978116558 container died 55448c28fc2622613636d4e2646f9388fccbb9b0cbb7b2ad63635bebff059a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:20:48.387 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:20:48 smithi122 podman[71794]: 2024-09-19 09:20:48.12768681 +0000 UTC m=+3.348142349 container cleanup 55448c28fc2622613636d4e2646f9388fccbb9b0cbb7b2ad63635bebff059a50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:48.387 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 19 09:20:48 smithi122 bash[71794]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:20:48.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:20:48.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:48.590 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:20:48.590 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:20:48.590 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:20:48.937 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:20:48 smithi122 systemd[1]: Stopping Ceph mds.k for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:48.937 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:20:48 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k[62615]: 2024-09-19T09:20:48.889+0000 7f6c68e27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:48.937 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:20:48 smithi122 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k[62615]: 2024-09-19T09:20:48.889+0000 7f6c68e27640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:20:52.033 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:20:51 smithi122 podman[71915]: 2024-09-19 09:20:51.77638782 +0000 UTC m=+2.969887369 container died de3d22b1ac16b47eae7a597dc9f6b81606bbe144e3d4d037c2481247c00dbbcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:52.382 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:20:52 smithi122 podman[71915]: 2024-09-19 09:20:52.131203459 +0000 UTC m=+3.324702962 container cleanup de3d22b1ac16b47eae7a597dc9f6b81606bbe144e3d4d037c2481247c00dbbcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:52.382 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 19 09:20:52 smithi122 bash[71915]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:20:52.505 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:20:52.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:52.539 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:20:52.539 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:20:52.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:20:52.855 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:20:52 smithi184 systemd[1]: Stopping Ceph mds.c for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:53.110 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:20:52 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c[65926]: 2024-09-19T09:20:52.853+0000 7fb26f761640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:53.111 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:20:52 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c[65926]: 2024-09-19T09:20:52.853+0000 7fb26f761640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:20:56.038 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:20:55 smithi184 podman[74058]: 2024-09-19 09:20:55.739668062 +0000 UTC m=+3.004622326 container died 92a1dc137dce9e10714c86f442b250c119cf2783d71f09706aaff14c0987dc04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:20:56.397 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:20:56 smithi184 podman[74058]: 2024-09-19 09:20:56.136940723 +0000 UTC m=+3.401894974 container cleanup 92a1dc137dce9e10714c86f442b250c119cf2783d71f09706aaff14c0987dc04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:56.397 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 19 09:20:56 smithi184 bash[74058]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:20:56.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:20:56.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:56.576 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:20:56.576 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:20:56.576 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:20:57.150 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:20:56 smithi184 systemd[1]: Stopping Ceph mds.f for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:57.150 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:20:56 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f[65629]: 2024-09-19T09:20:56.890+0000 7f25ed095640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:57.150 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:20:56 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f[65629]: 2024-09-19T09:20:56.890+0000 7f25ed095640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:21:00.066 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:20:59 smithi184 podman[74189]: 2024-09-19 09:20:59.736938948 +0000 UTC m=+2.944456703 container died 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:21:00.066 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:21:00 smithi184 podman[74189]: 2024-09-19 09:21:00.065599077 +0000 UTC m=+3.273116822 container cleanup 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:21:00.400 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:21:00 smithi184 bash[74189]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:21:00.400 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 19 09:21:00 smithi184 podman[74201]: 2024-09-19 09:21:00.266682186 +0000 UTC m=+0.529330520 container remove 983f3870c3b89858be248a8cd4db9c0c0ca70afb9b137595da411b47c4d41c6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:21:00.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:21:00.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:21:00.524 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:21:00.525 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:21:00.525 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:21:00.845 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:21:00 smithi184 systemd[1]: Stopping Ceph mds.i for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:21:01.150 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:21:00 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i[66226]: 2024-09-19T09:21:00.844+0000 7f3388e0b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:21:01.150 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:21:00 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i[66226]: 2024-09-19T09:21:00.844+0000 7f3388e0b640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:21:03.900 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:21:03 smithi184 podman[74311]: 2024-09-19 09:21:03.732719647 +0000 UTC m=+2.989715982 container died 56af261455cf3421b63205575aee1251180a5ce059a24d13f9300c6178e35a5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:21:04.270 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:21:04 smithi184 podman[74311]: 2024-09-19 09:21:04.052138505 +0000 UTC m=+3.309134837 container cleanup 56af261455cf3421b63205575aee1251180a5ce059a24d13f9300c6178e35a5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:21:04.271 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 19 09:21:04 smithi184 bash[74311]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:21:04.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:21:04.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:21:04.526 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:21:04.526 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:21:04.527 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:21:04.840 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:04 smithi184 systemd[1]: Stopping Ceph mds.l for 68681c4c-7664-11ef-bceb-c7b262605968... 2024-09-19T09:21:05.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:04 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l[65322]: 2024-09-19T09:21:04.839+0000 7f1b2b554640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:21:05.150 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:04 smithi184 ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l[65322]: 2024-09-19T09:21:04.839+0000 7f1b2b554640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:21:08.016 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:07 smithi184 podman[74431]: 2024-09-19 09:21:07.757710689 +0000 UTC m=+3.014841558 container died 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:21:08.016 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:07 smithi184 podman[74431]: 2024-09-19 09:21:07.99762549 +0000 UTC m=+3.254756363 container cleanup 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:21:08.016 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:07 smithi184 bash[74431]: ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:21:08.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:21:08.450 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:08 smithi184 podman[74442]: 2024-09-19 09:21:08.181864326 +0000 UTC m=+0.411432001 container remove 5a3aec50ab11378ce8e885b838debd1d27f149350691267a7e026fc312ec2911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-68681c4c-7664-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:21:08.450 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:08 smithi184 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-19T09:21:08.450 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:08 smithi184 systemd[1]: Stopped Ceph mds.l for 68681c4c-7664-11ef-bceb-c7b262605968. 2024-09-19T09:21:08.450 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 19 09:21:08 smithi184 systemd[1]: ceph-68681c4c-7664-11ef-bceb-c7b262605968@mds.l.service: Consumed 2.645s CPU time. 2024-09-19T09:21:08.461 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:21:08.461 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:21:08.462 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:21:08.666 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:21:11.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:21:11.262 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:21:13.885 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:21:14.085 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:21:16.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:21:16.569 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:21:16.603 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:21:16.630 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:21:16.632 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi083/crash 2024-09-19T09:21:16.633 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:21:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:tar: /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:21:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:21:16.702 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi122/crash 2024-09-19T09:21:16.703 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:21:16.739 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:21:16.739 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:21:16.741 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi184/crash 2024-09-19T09:21:16.742 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:21:16.778 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/68681c4c-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:21:16.778 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:21:16.779 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:21:16.779 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:21:16.871 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:21:16.871 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:21:16.873 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:21:16.876 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:21:16.905 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:21:16.906 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:21:16.907 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:21:16.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:21:16.911 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:21:16.911 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:21:16.911 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:21:16.911 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:21:16.913 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:21:16.919 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:21:16.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:21:16.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:21:16.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:21:16.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:21:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:21:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-19T09:21:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:21:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:21:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:21:16.922 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:21:16.923 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:21:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T09:21:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:21:16.924 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 87.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:21:16.924 INFO:teuthology.orchestra.run.smithi083.stderr: 94.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:21:16.924 INFO:teuthology.orchestra.run.smithi083.stderr: 94.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:21:16.924 INFO:teuthology.orchestra.run.smithi083.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-19T09:21:17.002 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 87.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:21:17.022 INFO:teuthology.orchestra.run.smithi083.stderr: 90.3% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:21:17.037 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:21:17.082 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:21:17.088 INFO:teuthology.orchestra.run.smithi184.stderr: 90.5% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:21:17.091 INFO:teuthology.orchestra.run.smithi184.stderr: 92.3% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:21:17.100 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.1% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:21:17.101 INFO:teuthology.orchestra.run.smithi083.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:21:17.104 INFO:teuthology.orchestra.run.smithi083.stderr: 84.5% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:21:17.120 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:21:17.122 INFO:teuthology.orchestra.run.smithi184.stderr: 82.1% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:21:17.131 INFO:teuthology.orchestra.run.smithi122.stderr: 92.3% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:21:17.209 INFO:teuthology.orchestra.run.smithi184.stderr: 91.0% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:21:17.401 INFO:teuthology.orchestra.run.smithi122.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:21:17.401 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:21:17.401 INFO:teuthology.orchestra.run.smithi122.stderr: 90.4% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:21:17.792 INFO:teuthology.orchestra.run.smithi184.stderr: 94.1% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:21:18.044 INFO:teuthology.orchestra.run.smithi122.stderr: 93.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:21:18.459 INFO:teuthology.orchestra.run.smithi184.stderr: 94.5% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:21:18.523 INFO:teuthology.orchestra.run.smithi122.stderr: 93.8% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:21:18.631 INFO:teuthology.orchestra.run.smithi083.stderr: 93.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:21:19.770 INFO:teuthology.orchestra.run.smithi083.stderr: 90.2% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:21:20.351 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:21:20.744 INFO:teuthology.orchestra.run.smithi122.stderr: 91.8% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:21:20.749 INFO:teuthology.orchestra.run.smithi083.stderr: 93.1% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:21:22.228 INFO:teuthology.orchestra.run.smithi122.stderr: 93.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:21:25.346 INFO:teuthology.orchestra.run.smithi184.stderr: 93.2% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:21:25.372 INFO:teuthology.orchestra.run.smithi122.stderr: 93.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:21:28.460 INFO:teuthology.orchestra.run.smithi184.stderr: 93.2% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:21:31.534 INFO:teuthology.orchestra.run.smithi083.stderr: 90.5% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:25:33.214 INFO:teuthology.orchestra.run.smithi122.stderr: 91.8% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:27:32.212 INFO:teuthology.orchestra.run.smithi122.stderr: 91.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:28:41.086 INFO:teuthology.orchestra.run.smithi122.stderr: 91.9% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:29:32.916 INFO:teuthology.orchestra.run.smithi122.stderr: 91.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:29:32.917 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-19T09:29:32.917 INFO:teuthology.orchestra.run.smithi122.stderr:real 8m16.026s 2024-09-19T09:29:32.918 INFO:teuthology.orchestra.run.smithi122.stderr:user 6m36.130s 2024-09-19T09:29:32.918 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m15.494s 2024-09-19T09:30:56.278 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:31:50.576 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:31:52.428 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:34:04.624 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:34:04.625 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-19T09:34:04.626 INFO:teuthology.orchestra.run.smithi184.stderr:real 12m47.734s 2024-09-19T09:34:04.626 INFO:teuthology.orchestra.run.smithi184.stderr:user 7m19.939s 2024-09-19T09:34:04.626 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m17.411s 2024-09-19T09:40:01.917 INFO:teuthology.orchestra.run.smithi083.stderr: 91.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:45:41.736 INFO:teuthology.orchestra.run.smithi083.stderr: 91.2% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:46:58.197 INFO:teuthology.orchestra.run.smithi083.stderr: 91.7% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:47:36.086 INFO:teuthology.orchestra.run.smithi083.stderr: 91.6% -- replaced with /var/log/ceph/68681c4c-7664-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:48:56.199 INFO:teuthology.orchestra.run.smithi083.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T09:48:56.201 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-19T09:48:56.201 INFO:teuthology.orchestra.run.smithi083.stderr:real 27m39.311s 2024-09-19T09:48:56.201 INFO:teuthology.orchestra.run.smithi083.stderr:user 10m6.222s 2024-09-19T09:48:56.201 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m28.492s 2024-09-19T09:48:56.202 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:48:56.204 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi083/log 2024-09-19T09:48:56.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:50:28.633 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi122/log 2024-09-19T09:50:28.635 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:51:33.167 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi184/log 2024-09-19T09:51:33.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:52:46.851 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:52:46.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:52:47.266 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:52:47.987 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:52:48.432 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:52:49.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 68681c4c-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:52:49.785 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 68681c4c-7664-11ef-bceb-c7b262605968 2024-09-19T09:52:50.550 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:52:50.550 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:52:50.571 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:52:50.588 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:52:50.612 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:52:50.612 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:52:50.625 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:52:50.625 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:52:50.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:52:50.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:52:50.769 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:52:50.781 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:52:50.781 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:52:50.784 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:52:50.787 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:52:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:52:50.799 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:52:50.802 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:52:50.845 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +503us[ +483us] +/- 40ms 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -1805us[-1805us] +/- 75ms 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +858us[ +838us] +/- 64ms 2024-09-19T09:52:50.846 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +519us[ +502us] +/- 40ms 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -1798us[-1798us] +/- 74ms 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +837us[ +837us] +/- 64ms 2024-09-19T09:52:50.847 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +566us[ +542us] +/- 40ms 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 2 -1714us[-1714us] +/- 75ms 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +892us[ +892us] +/- 64ms 2024-09-19T09:52:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:52:50.855 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:52:50.866 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:52:50.866 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:52:50.897 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:52:51.043 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:52:51.132 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:52:51.252 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:52:51.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:51.286 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:52:51.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:51.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:52:51.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:51.343 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:52:51.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:52:51.411 INFO:teuthology.task.internal:Duration was 3987.040189 seconds 2024-09-19T09:52:51.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:52:51.493 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:52:51.494 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:52:51.496 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:52:51.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:52:51.553 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:52:51.565 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:52:51.574 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:52:52.028 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:52:52.028 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-09-19T09:52:52.028 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:52:52.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-19T09:52:52.060 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:52:52.080 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-09-19T09:52:52.081 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:52:52.114 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:52:52.114 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:52:52.117 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:52:52.123 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:52:52.183 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:52:52.183 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:52:52.187 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:52:52.189 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:52:52.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:52:52.750 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:52:52.750 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:52:52.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:52:52.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:52:52.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:52:52.840 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:52:52.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:52:52.845 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:52:52.872 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-19T09:52:52.892 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-09-19T09:52:52.909 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-09-19T09:52:52.932 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:52:52.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:52.947 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:52:52.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:52.961 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:52:52.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:52:52.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:52:52.998 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:52:52.999 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi083 2024-09-19T09:52:53.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:52:53.047 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi122 2024-09-19T09:52:53.048 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:52:53.085 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911879/remote/smithi184 2024-09-19T09:52:53.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:52:53.123 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:52:53.123 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:52:53.125 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:52:53.128 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:52:53.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:52:53.184 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:52:53.184 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:52:53.219 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:52:53.219 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:52:53.222 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:52:53.224 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:52:53.234 INFO:teuthology.orchestra.run.smithi083.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:52 /home/ubuntu/cephtest 2024-09-19T09:52:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:52 /home/ubuntu/cephtest 2024-09-19T09:52:53.239 INFO:teuthology.orchestra.run.smithi184.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:52 /home/ubuntu/cephtest 2024-09-19T09:52:53.240 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:52:53.257 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:52:53.401 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} duration: 3987.0401887893677 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:52:53.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:52:53.489 INFO:teuthology.run:pass